


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations l. Thesis and Dissertation Collection, all items 


1991-12 


A Hopfield network approach to direct 
adaptive control of nonlinear systems 


Starsman, Raymond Scott 


Monterey, California. Naval Postgraduate School 


http://hdl.handle.net/10945/26576 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 


) τ D U DLEY research materials and institutional publications created by the NPS community. 
FW : Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


"WM KNOX appointed — and published — scholarly author. 


LIBRARY Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 





bib cs bh πόσα} 
ο da bee 

moy dapi 
grin 07 dm he n s 





νι «ποπ 
νὰ 
CIL απ οι LC oL 

wu 














Se LII moe Neate ee 
E EE PA ΣΝ LN LX 
arid XEM 
πα 

ΠῚ 
-- 
LAC S 
ο a tro oe 
ΠΟ i 
oh Se, pe 


+ fe 
. 1 Κα χι E ai o ου ουσ" Ὁ ο Ft 

"ΡΤ ΝΑ oe 

LU Φρλρκ αν” DIU 


out se wT Gh MQ” 
τα ας 

a Te bd 
PL edd 


perio ere ear I IR Ἢ 
+ & we Parie DT old ντ. 

GUTEN A ΠΤ H .. 
κος" τν, 

ΠΤ ἘΝ D 

, BL d. Mi i A ae 
2 μμ. ^ η me ty 
το n r . NILUS δν 














DET Η 
πο ντ UPS κα 















H 





ας 
τη a Ον, 
ιτ μα οσον 

ΠΗ M te T) 
μονο! ay 








-> 
poA Pa = D 
ΣΡ, ΤῊ ΝΕ Να 
Ὡς ha 





η ee 
Στο 
PETA OOE el 












- 
ΣΤΟ ο Μο 
LU Dy "Dern rr 





TIL Last Lodo 
FUN ETT Ud 








d 




































































































































































































μον aleak 
ο ο ΑΟ Γωνή 
L4 ^ La 
erie nen Sheer peak ον ζωα ECRIRE ds Φε προς Fg lind 
LI o PLI 'We Ta rac! E E 
Moins E νεο tp; Pee μ Aer ? S E ms 
eye a ολ... πο... ud m. LE eg ag s 
ο κ η ασ ο. Ml ΤΡ ἘΝ τι EA ας FR P σα EA i pev rixae c CM 
Pel Em Dc BALADE dd το, n5 cie e bt IPOS ας φις be a πρι αλ μα "ZEE 
bie CEU ER TTE atu sut ο ο a w Uv ee an att ΗΝ 2 at Va ata ai c? u^ P cR ο] E 
PE ΜΜ ΜΑΡΙΑ” "Eh B Μα ΩΙ ολλ, food M om nodi Led Mab Papai > Pret tee ο ee ast re ene ety πασά 
de Αμ) δις ομαλή ἀπ ο rela Arr μπρος. [ΝΗ ira dn ο ον ο LENS "Arr 3 A a EE τ Μο κα ΕΣ κ 
in bios pn? nei ped Ed PRN TS leah sib 19 1 at pe Pa d in “4. 5. A De La con aet T ayp t 4 ς cows IMMER Ld di EM E Load ds Ud ΑΙ ΕΝ PRSE at sd a 
η (ot piu etre Pas g diia Prod ida Le νι να m Rd ee ge ane xw ^nm. Er irc ος ρα C πμ iir ed PEN ος απ ELLE bak aad μος ΠΗ 
he ht Pd aibi indici re pedes bam eroe infert. Ld E 4 ^ ae d d > re Pd ar ed ie EN p * ὃς rd kd a B 2 Jj A var ΡΏΡΈ E PT ewer Pte orien verry it, yet Hear vs 
de les reser ter ay Reb Heel Ισ serra Se aby? Cnet eaters Vp eed ο oe rese ο iem pe νά E ο ο ο ον. T E ος : "oet PR Tn era. Leng Pape Pere E ER Redi 
ertet IT Linn agita 7m) LEAL LL] CENT ERROR E ΩΝ belinda ee ee m A - 1 Pett 5 P "ad OS ρα ον 12 ` rie ^ tot ΓΡ S » 843 * 5p iym Ἢ Por μον μα ΡΟ 
πο ors ο ο Μη LEYT DESS μμ TTET A bida ed" ΧΏΡΗ ΠΣ ΤΗ δὴ ΤΡΙ ΠῚ κ αν.) πα PA 4 id [o * οἱ M rd "ES "TIENI De ^ οτε . ^ PUE E oda H "TETE ΕΙΡ ΡΕ Μακ ώς μμ κ ΜΗ gerd or e EI 
t» μμ er tek d ως μμ οἱ pop ^ η ΤΟ πη πμ LL ον μμ μα «ο να a ον ο Pa αντε νο [λίρα αμ. ΠΟΘ ΤΟ T adis r OTT ET atka syo 
Ακ νο ΣΣ ΑΟ p y LETT ERE ΜΡ ΡΕ τ n Lodi Lodo ή HA μας σὲ PATE rie dpi. κ gi b μαμα ο Το κ φως νεο ήν 
πο αημ Αρα He ri Unip pide B τ ΟΝ ΙΗ ΤΡ ΤΝ e- RAD Pe A Cue Ty pie hae aed κ LU T rhyme να - LE MEPS μμ μη. 
ΗΝ ae he Sade "MILES "TII DE μα. ΠΙΟ "I 4 FILE TTR E: ο ανν f ὙΠ μμ πχ Ἐπ cub tne with ne ἨΈ notes) 
πμ αν”. Dear ΙΟ ΤΉ ον το Ἑ Φα”. . ο ο PRES Jo AD dpi ως κ ΘΟ ΘΝ Ίνα Ον ΝΤ ασ A e 
Ju C tse ata P p uns ΓΚ ΣΣ ΥΣ E "mL M UM TE ν ie i LR SP Len A Τον ο ο Μα σι τμ ος 
5 πα η d a4 Po nn Sem $« νο ο... ο P ar bl d che Sa ο a TE A Lidot. a ντο Cheep ear apis Fol gear μέρες 
pa ο νο, eque d ιν ο ο ρω μμ οκ μμ κανω ipe a den 
-— NM GST Set ra T aude Μι μι Rin lie ΙΕ ΗΝ “πρ errr Yet AL bidet πλ κά 
ET dbi. | n ΡΥ iw ae ΤΟ recu Pr EN PIT iei duisi 
ard AA eer Pared OA πο μοι ei dept iiit 
d A Pa Pink Ted hp e 
prec rimis ών 


ο 






ολα tia p aenea iin 
"Ὃν raara ELI Ld 
Ld EFTE eee oP oe oe eed ΠΡ ed 
ο αμ ΤΟ λλοωή 

κι να κ. 
f.) Pd DUET Rid nd 





nda ii nie 

ον. κ σάν μμ ον» 
μι φον ια heed at 

yd bero 


OTR ETLE e er 

ΠΗ μον "te had EXPERS LP 

Ld Lo: Eee 

JN “Gas «ενα 
EP 


ΠΟ λα 

D 
98^ za 
«. σι δν ον ο εν ολ” 
TEILE DEL 
Mae TL d 


es ή 
ee En ot) ob a ead 

ο 
οκ. 











ος 
ον ed σά 
σα E 





CA waaa Anra Gan: 



































M o 
NET LLLA 





LLL d fe Μο. 
απο. ου. 
" 





ο μον 
MA 
Lob 
4” 





redis ong) 
















































































































































































































































































































































































































































































































































































































































pp ο 
γένυν ΡΝ arem rr PLE αὶ 
ο λα.) μασ ΡΟΝ ΤΩΝ ρωσ bili ΤΩ mI dai Li 
a EL oe rahi sage tag fh λεν» peter ΙΟ, Τὰ ἀμ 
poy SY SO T T abaa wT ed PMCID Eee da. LE 
ματ ρω ο EL Er : " LEG T “58 ος st 
at ada mera rele” Wei idis in BL r ή à 5 A a - aay " » 
orae giri rr OE πμ a TT M EI : ο. af 
Ξ 3 "Ix. κα» re abd d ων hd 
pork τν νε, : PM Polus ια Ca * ΓΕ eh ae ed EI ΜΕ dde μον "nm μμ", ο ο δα 
πι Lidl P PA eA "nat € tsi ree Pe ήν Peer pda ο. v rye 9 M" POSENT E dr. odi I ee ee ον abd tia ja avr Ἡν 
ο ο... ον ο τ. πα E dili rd TN E ΠΝ ΤΊ ΠΥ, 13 δε κλπ a , & min 6 ο d ο) ἃ "E E LET X ΚΠ PA or 
pP iid : PT TUE T i a ΔΩ lanier ded aaa ον ως λεία νι τν wa of, 7 r Len RPM "* . ος νὰ ER H EN te op PORE PL he ΜΝ ΤΣ ΤΕ; m μυ Tree rr 
PILIS mr η Es dd Ed ud d XD LI d odd $,2*4, 4»^* E alll eae eds AN 8» vta s d1e9 e 2 T E a T E TE tebat AP πο λε λα πυκνά 
να ώς ο p ier frr des : M en Hra E OREL Ld warm μμ 1 πώ σε καποιος 
νι μον TEES ώς FUE S a 4 E "P d Pat cate’ 1 ο eaE pde m, uy 5 ους ΝΗῚ Vent {γεν τήν e om o κοκ dieat git. ieee 
συν μμ κ. νο ο ος nios κα, s κ ML rane ο. ας μα» ptc ο ων σαν 
te” 1p Fark * g um a DE e Pe LP RES a PI ed vp? E.,***t*, Επ μη αν ον κι σα vrai ls pi fe xe ta en Ty pein 
e «2 * ESSE 1 "T IP peo none IJ agua tin E morer 
ἊΣ, ή ep 6 Ue "νυν. ο ur e Pre wi 
"IM PILLE A ene SEATS ασ" E HM LAM gee μμ .. ΤΏΡ ο 
ΓΕ ΓΝ; vas » η ΕΣ ΤΙ Lud à" .g à x qa "o c* LE μα μμ al 
"e πο ασ. ri ETE Τη e Sy tie) aa eee [X ld LP ud Lu uu S Τὰ κ LI 
Mr PRICE ικα ἤ DAL C 2f v OE. κο. H μα ^ NL Sur Eae NE E πω Mee MA a t uli A esie Aen srs 
G S E PELLI ΤΟΝΙ be Ha EN DNE "did - ο, al . LN] E E a m ο πα. οκ μα ντ] ra f tm 
MA ere tci Wee did μη rini τος Me ee τὰ Oe sa a --’ 4-4 15.42.4 ’ Φ.4; Ε-,4 Δ; »- " εν E» PCI Wrette or ee "ARCEM er hs - + eh Pearle tit 
be tite ο μον ο LL dd LE P f [TL [EL "at ee E LOO CPUS * APPLE N Pd du d "AP NEN sd "PN ια ΠΟ LI ΡΠ tt ΑΡ 
μυ μμ ere Μη ΝΤ ΡΜ, ΓΗ ΠΝ AE Prod La P PME M ΠΠ πα ET E ? ΡΣ zs LS m LL nm ο ασ es 
νο ο ού PHELPS υπ μμ ντ IH sae a. *, M MY AP CES αα LS ad E edi ΜΠ AH ioak iona rn soa ew EPA E πο τε: puce 
ΡΤ ΠΤ μέ tel μον ο ο νε... id DETIENE Lidia L Li PE vn - ad ^ ry dd Xu ia Aa's P ad αλα οἱ μον td 
πο ο ο. 2 [M EM "EP PEEL LEE AE d [PL ud PTUS Ed (9 FE "E i "P EI * Peg P eee Te pr ens $ 
i LE P e di 28. Ka P AND A "5 PUER PLI "E ΞΗΡΟ Henne Krc Pe 
αμ FO WEE LC LS tue ow rV ^ a tie Mene Εν ΤΝ Matar Ap ed REITT i ra e- 
naire fh Tes ta pir Cad υπ ας ο κος «w^ se NELLE "€ P Pe ert are re CPR eT atl a G Nec nee tt te ΠΣ 
γρ ο ο μμ νο eee oy 4 PP PEE. e« £r -ᾱ wes NE ndi: Po κ ια amy Ra ο ey ey Bev epee er nS Tal 
ο παν ζαψ teer μα ως dud hdd Noe eL c hin b Pa ai Eric i “τέο [λα αν νη MNT Ρον ee ae ΡΟ "rU ok 
ο οί Ee oho big ipic IL Leeda lenient ame "ELI Π dissi: anas curry E T E a T κ προς . μμ νο bor] μμ ών odiis e d 
Urbem μην μμ ο ο κ a AA mr ΗΝ LI Mb, tete as ad s& 9 &N . Ld aver LAE, a ο. . » “Ὁ [NATI «te Q3 ΥΣ ΣΤΟ, 8 P trout ΧΗ”. ΤΣ μον ὟΝ ΣΩ 
να ἃ "Ἂν, πο αλλά νην ον ο ο ah ὙΠ ο κ aed atis πο IL a ΤΩ M n di EN ο odii ή ο. ΣΤ TOP ae ped νι 
γρ ο ο sii bain E "id TIC ee Poets oh od i) [^um EP CREE dl -.»»” LIC oe LI fur * τω. .. w-- 03 a ma edu se P o P a " P] à sd n "v μονη ο ο ο να poer" 
saei eat een Με κ ας Pe Se ES bed ial atic i PAL eRe Ln Pao girdled Doi E OI iti! Sr ΙΝ μα» μωρά ο a " supcr Puta ribs ert dion 
πω nod PT dd LUE TI ELEC d . FT Lh] E P bd pd ΠΠ; [RÀ T LII ΡΝ ΕΕΣ, een He Tu ΤΙ μμ φον η ον 
αρ οὐ ΠΕΝ ΥΩ esperar CERE E X rid bed "hd Γ Sa η Edilio ΠΤ ὙΠ Pb ee Sar eer ~ 
eund "D ΡΥ, LE na mri ie MTS EN Fete ^ ori FE 
ορ ο κ, ρου αμ n. E ET ss los ee ELLE E a) Καθ μις ντ 
vieron t pid raa ών πό bh Sa aT er FALTA A * b a κ se o d h [πο νε δια 4 Pe ον ο... ΠΣ 
narii arora siagan, am Posa? Ml ΡΝ μεν νο δη ud ei LE o. ^ d μμ a DIDI ed bey parecer peel D 
M ids ο had tatur "RISE Fagot: 1.5 να πα LE on s oca 7 PLE odd + " H i ΓΗ E πα μη EH ed E epist 
μυ ο te hal νο ο πω. PP bd ubi ἡ DLL Fo E rac CTE id rep testae ' LN RN ha P Lu vary oy c ee asta LAE ο γω. * Pee et uL Ps Fa 
Pe ee hed ΠΤΙ ΠΡΟ, ΜΚΟ ΗΝ D νο... g Lr E Ε 1a ee " δ Wy qoc P ier UL dre Face pd eee oe ipie a 
k M pL M Har PE ror poc Er s τα. DM NE EU πρ”. "ro n astu, we n MOL TCR PEPPINO r a ΝΣ πω μέ φρένα Na 
PTET TE [LI ^ Peer re es E BPS .t er? - ναού all CLONE LL Loc LP CLERC 44 > PIXEL AL v. Εφ ντ ΠΡ 
πο ΝΕ deel ο ΙΟ αυ EIL τω z. - " LAS Y ΤΗΣ μας edite IN Bien 
ιο ο ο δν νερο dl dd ROI LL k E o 4% > pew 3 4m: re eee P ae = = tay πλ. D iMd P ος 
ου σου PC ee ΝΤΟ Ον 2 P ILL d Ld us ELLA “νον. Iud νη G A [1 d πα; κ αμ ΟΕ e Bal a Ελ. 
ne bed ον APT MD ο) DELL Ἐν zi CTS M XL ο t Caec * ON LL DE eg .. A "PSAL ates e © g Wing PAs weeks © ΠΣ ΠΤ ΟΡ a 
evndars = a as Bec atak ee ο ΠΠ CTE E ΓΝ ΓΕ ΕΟΟ Εν ην. ων ETa a ο eae ee Μα ο ct 
nr ο”. LA E » » eg At LM d a v g "E ,-- "a ^ 4 NEN P e & mo sps" E 
Hep Nd κ ΡΟ αν στο”. nr T ^c TL M d "TER aM LU E 
s TE E TEE T ο © 4... «π-» ἃ ΠΤ P oe s ota” =e: 
μα μα ντ... ΡΝ er "age LS ΠΩ «454. 4Φ’"’,8 E ΠῚ 
ρου μή ο καν ΩΝ ΝΚΑ ΡΝ "m PTE P "TP st r ΠΝ λα 
Tr pe ae d be ο... ΤΟ. ΓΥΡΟ μα... . ΓΗΣ Τη 4 x s ! 
Pte ο. mere I κο απ... - ΤΣ "LL uu ~ πα ALLE 
PII dell LT s μι s "m " ο ο. F r a a à 
“τς ΚΡ "TP ΠΝ ΓΤ; αλ. 2 A. ι EU te ΤΝ να μιά μυ ο. 
Ην ὙΠ. Ον Ἢ PES n se . See ee LEE eee ee φας Ln 2 ο Οπή“. M Ode how PN EAR. $9 PLN r 
-.,ὦ--ᾱ-Σ Ἡ αγνέφρα aW o m e A E "MNT i sels Li E d oed μα Pe ο r n ο τομ. 
χο do EP Tene ad ege rid Aa μή s ^u à 5 ο. ii. id E E De ν᾿... ΥΥΥΥΎν σὴν 
μονο μωι ο ο δη ον ο d H m alia Ate iyd x . ΄ LIA "pte 9 IX XE "Tn 
ο... € adffow * det a te P LA LÀ mL FPE --- buit "ENTM LIU Ἴ 
πμ γρ μι ΝΡ ΜΗΝ δα p E “ο κ. ME an a uc A IDE LESE 
ισα μα á s AE TT να PEE ii 
Croat HK oat Ri oa 3 — c » EI PE bol » - p nm T 
rp NOR a Ls [τ ae MK . ^ E E -.-aAe;» wes * ^ad ΤΕΥ - 
ασ” ^3 e *»" ο ον... s ο τα νυ " Li E E . Pa Cae PIPELINE. ο ο ο.) 
ΠΤ Τη ροών τα. ΟΙ; PC PEE LM A - 9 €. 9 Ὁ «- . νο; ο - weve Ρο τα... ea Ye ee "T 
ΠΥ te o P πο ο ο ο ΄ S g>. wsi P PE νον ὑφ, »Λκῶν “ο! ν a. ΠΚΣ r2 me . norme uL cd e 
"T n COO lE - r . .. LI ΙΤ; . eee ie eh . ar ΠΩ ΣΙ UN ave & [Lo] 
? PII" ii id "EN EJ - Ld z Li LE P ad " » ΠῚ - 8 ΤΝ re bu d 
aoe Ome POP ο ο... t,i e ~ . PIE DNE F1 ry νο ο ματς HERE e RE TO 
er a ληνά ΕΘ ΤΉ E DIL LM * ow t. -. e LEN e ΄ Seer c) s.a? πο" ον ΕΥ 
πω ΡΝ ΕΕ d ΠΠ ΙΙ ΡΠ LI κος 5 ο ΤΟ ο ον ebd - dum bo w^ sw "99 nr | L4 oe ® -e o η ο να TELE A n III A * we P » aa yv ΟΥ dl 
pnr mL ood LH ‘ POCHETTE died ινα ο” ee ee he P rM" | PE - ee tee E os . muro XUL C dd 
μι ee ος POPETI ιο «πο ο... "TU ΠΟ T S η τος "x ο”. rae ea ΠΠ ην νο σα E Lor aea pes dx 
Rud e! tAv "Ia fl m ML Lid IT ECL ^e . ο. - . .. L "E LI ΠΠ bed ο . "TE ο 15 ΤΙ ΡΤ μπω νο λα. 
PY Ι.Ν D v . 5ο --- .. Ὁ ra . A HORT P A gr aan cl oie erte tere 
πο ο” E » Ed οσο TL NL A MU E ECCLE ne waa Ἡ a e cav sieh gi 
"TM ΠΩ ΠΠ ta. "mA - L "IPEA TES MI 4- CIELO a ~a s Fee wWo- - i0 ^o. mm ap rana om 
"Oc" P Pr EP 1x Ed ve sos "EO Ps FEEDER TU MP E I Ες e νο ο ο ο οσο ο ζω οκ hepate 
Basis rn ien LE 2 VO ot a edhe αὶ κ d πμ κ iiie. d ^ ο. » "+4 L Ολα E N EO E A 
r ο ολ νο ο οσα, "EE LE ae D AE Soie η LE oed La Er cu ONU CIRC οσο ο lm E [ο στ CB d ο μη «-.- 
μον ικα ο ο cid ΠΝ; ΙΟ ara e mm "LN [v a eo, wi “ να ο A LN , . x m MB TN m E TIL ιο ΠΚΣ - .-“ν -ῳ»ο'- 
πο νο κ μήν ο ee η ο ος pte oui ΠΤ LRL: Y id 8 -ν ιν E E mE TII πα η Ὁ n nd 
μας d ΙΟ. "mI ΠΠ "m D un ὄν; " zw μας act ae pes aie nic EP p^ κα ας 
ο οι pid papi Age i-i PI LR dl d dd P acne "LL T T ΎΤ,, Τ.. a 
Μη τη αμα we « » v ο μα P ΓΣ ΣΤ Ων 
flict ata » LES ND mL - Επ "a “5 ren" 
die E € ο η» Ξ ΕΠ T τον a Nr ον σσ 
ML j 4 -$ είς ΠΣ A ae) «νο, μα LL d ital ο πο ο i tt ed 
[DE ose he Mee A 9 m id o P LC LÀ D ΠΤ Πα -—— - 99 
we LE a "^ LET up rs E τ; αμα e €9 Ra * «9- a 9 wa L da 
= a o πα E CAN RS RA: 7 "i ace σα E ο μα = Sele 
G sa B ΠΠ ο ολ 2: πα λα αἱ ποπ ΠΩ 
. E ολ. E M ὁ arna y a Euren AT E L E a Peer Oe ar DE E EE red didis 
Ιώ ed md τὸ = dos LL aa LI η EI i ΠΩΣ πα οὐ οω-α ο Pr INE LE dL rx μοι ο 
«” -:»φ.» "». "PX « Ἢ Τη " "a P "PD "o nuc te 2: χρη Μας η eee 
“ee EVO τ. « PL FEN ο an? « £ tae FI a Pern Tey et PLoS T E) ee naa oe 
pe Te aL USE" E a P 2:3 LEE DENS P RP LTD να ο * E ag ο αχ κος 
ποσα pieno M ο” baal dL EDS ^-^ hs Pd ea ic “a ΚΞ 9t n "Bros ΄ E T ey D 
P n P E d bes a w ~ . P ote EE E RE i H ΡΝ I diis 
i . ** . - RAN E ΠΤΙ ee =e ere Ce ον Py 
ΠΗ E maraner T T 4 PX E me 
' "d LIS -Ἢ- -a CEE 
P E T ada aa "IP 
^ oU "A - "P n n ο] 
Ta 4 n PEO ΠΣ ΤΙ * μου ουσ oe Καλο. 
L m2 DUE a re ee ie - 
Ld C . λα... LI ^ » s bk» a KT- *" a'» " * --» 
"νων dd 





PLE 
© ap eh ofa? 
eee 
E E 24 v a. t m 
PE E abd 






































































































"E LEAL 
ML 
πο E diio aiio LI 
PLI Pe ee Oe oe . "T od ον η p, 
r πο ΠΥ ΘΙ PCT Ld . » g III 
ULL hte oe πο ο Rta) et he eed P ΓΤ H . L] PII ud M 
fe ome thors εφ ΤῊ ee oll PEPTIDE E E ο”... hd TI CTT LE d [EFE 
μμ ου EET μ.μ. E ο ΡΝ ΡΟΗ a n n E LI Uu E amt al IL - D - 
ων ee ο πο... ef ermwrg.af Vae cru $0 D D * EE III ια] . 8 s Ce ae ed "n -Ἢ. - eocerea oe aa ο. 1... - ^ ολα... Μο ο. 
πι Ee road e am nt p ed n v n PE - ο.) - 50 ul E ^ ca BINE NN P a πο ο... 
mee ο LE * "a as sva ολ... ETT NL b . LIES etd € E *-. 4 ». ELTE c LU d P4 a tom mm ELA 
μονος * - * -- Er qu^ m m - - m -— TIL a "LI . ELI . 4 LUN. - Li . LI - ^.» .» 4 "ber m ον... dd 
οσο ο ο ο ο θα ο... DIEI »^€* a a5» e* Ὁ EEE] t= ο ο. A ο οκ μα en) ο αλλ ω νου 
"To pee ae [ME Jane t "NT nr Peer" “Ὃν E "I Hun LI κ.) Pe e s "a pP ο πα να απο 
πώ ρω PRI dpi e Μο die ο. - mee oe Pe eT i τά αλ... LTEM . aX* *'wnv*T r Aa mv 
μονο edipi P LT Li ie κ ... T PL te a " DNI po I η ΧΙ, ΤΥ. τ αρ 
ate ae n H i ose n LED ο ο r [E ik eee oa "LP 
parame r M en ees ae . α «αν ΝΕ, «αυ LN "Prep 
A ER πο λα.) T . .* η EJ ---.... ΠῚ ILI - "SEL L LG PES wo o» wnt e c4". ο a t 
nter Im E LIN Er -- "» » ad -— a E "2 ... S ee « »-» m Φ 8 νυ ν.Ὁ -- "XI" 
να μεις μη ΝΕ ΤΩ P [E p a. e . ... E P P LS. PELLE did PP ee IL ”.--, 
P I owin 5 s.es μα ο d Pd πμ on 7 ae a - E E . . E . E .. 
DE -- e ansaan --» e M. ΟΥ να oun LENT ww peeve oF Ἢ P" "XD MEC NM πει 
αλ”... ο ο aed δα ΠΤ Ων Ria ου E -. ΙΛ” τω E LL a ete. ^ > œ~ 
ο ο. afia t E ΡΤ er ETT T EL Fh "m E e ae» - 9 ^ cT η “ ΤΩ ο AS 
ena st te πο] ΠΤ απ. -- - E ΠΠ on PLE ` een mse 
LI E "SEM Ον ΙΤ M "m LI a.p - LLLA Li CE Ιω λα oo € € =. PNE ee πο ολ. 
μμ mE να ee E > Επ a λα =< -.-- ον ΓΣ Pe μαμα ΚΓ A 
EDIT Pd Pee ht = Li "1 E - Li [I * a Dr ni "IE Ρο ο... 
"m "P G T . ο... P E μμ μμ τς ο... 
d TE idis. 3b ui Ἢ "E -- αν - ate ate EI * e». ΓΤ 
Duca ο σας .. . Μος ene ea tone noe acre. > 
Pee λα, m πο ^ . t. ο... EI "TITEL eeee m PLI P LI RAI 
TEE MRE - . D Ἢ ca s B nue πο SEL. Me - wea” rl precum ο... 
ETTE E n" = a ΠΩ " P I "ww LÀ m - ε-- PELLE "IP " =- D er n ` PE » oc om m 
m exe we Part ar A τα = "n νεο ας n ro . PS ΡΊΠΩ - . " Pd ELE EIL m "IPLE ὟΝ MT 
PLIN r - e» gf.e& a^ 9 P9 4" s s ΄ Li tà E bd a caa τ id LAT - Ce a AM eee ET ae E PLEX 
m wom ~ "LE L "ERI. E * m B E ILLI η. Li ... AMPLIA Ix PITE S 
ΠΕΡ er 1) ο... ss = DI) "ICE E NL S, LE MEL 4 :» Pu vu ον η ed ΡΣ ΙΙ, ΕΥ, μου om 
n or - 8 9. ο ο. η "I n D 3 Ἢ te κ ο. ΤΉ Er LN a ο... αν. -πα, κ  φφ. «-ρ 
ΓΕ ων P ΠΠ αν λα etu Mec Mild etd DE s ee ` UNE oh ie ae CODE Cie Me ~ Paar ΣΤΟ EE NS lie E 
- A - » E E ο "nm ποσα wet am fs " PS A " - EI qul als n Τη e PEL Po Ο ΩΙ PW μα Με. ο 
--.------. - ἘΚ - ο. . η A ΕΤ; E E . - = . - ν νο E fe IE m * * E P ae "E LI πο Επ e EE E es ida A 
--.-----.ν'-» ΠΝ -* PII . 5 "LS E Ld Nd P 2 E PLIN 
E re a -— 1... s . * ae . κ... - " "m P P πο "I κκ. -- --- - 
ΝΡ - t t E ο LI 2 - ο st E s .. EIL PEN m 
1 e ^ - m . "> E P ΠΕΝ ΙΙ; ο. ΣΟ. πα μα αμ... 
TP Wa να. i a P T " E t7 Ρουθ "OTI ΠΠ 
pU ο . rd P ΠΠ - .* ο. * -- LL: ο. -- πα EE PES 
Rep cU E RE d 2 P" .. "n ΕΓ η Des or EE ο κ κ ο οτε να oo” ee 
ο - ^ ew. ir o E ..-- ΓΙ . " "I "es "ITE" MT E -. m 
Μο E erreper’ . "E E E ` E e E TETE ES LL - LEE on P E 
" D n" E €. 5 - οσο ο... n P men EET - D - - - E FEM P a - mea Γη ο. η wosp 
τε πα e ο ο ο οι οφ ROC. DS "LL cv ΠΟ E "PT E E E P E > .. "ES . - E E ΤΙ ce ^ 
"———— — ΣΡ "PLI PE LI B P - E ΠΠ; "E E CT a a E . e-—o . "m E - H P . - - ο. 
um πο ο ο ο. ~~ = DDR ο ο Ὁ .--- P =. E m E . PEL a = =. © Poe eee od 
Pag et ΙΙ E Na td Por ο E NL ον » ^ ea επ οσο .- d . - “ E . FEET a e P ΠΣ; 
E S E biu TAS wm pm ier - enr E "P Εν n T - ¢ PD - E rr E ΕΗ ΙΙ " as 
κ A aaa, Pe « ert rs " MT ο "2 m Ρ ὍΝ x a os PIN Li Ld " "E . E E Pa et 
a ia = m M E - .--- PCS LI no H " T 5 c A E - "e E . . - m . P E ΠΠ PE . " "E 
P E - ^ o» - a --.-- E - ον CE E η - PTS Ee + " < a’ - ^ va = - - a- LAE E er Ὁ fo PLE "D 
"T LE P -- ws ΕΝ ΠΣ - mE 5 EPI P "S - s asa c" L - Pier AL. * B e«"nweauatbe* «wet mI E 
ΟΣ -£- Pore a eee ee m Li "EL .. B*p* - A » M “ Γι; - ee - .. Ὁ es --- ETE a 
» B ^ = a ow A = ἘΞ m " . a B . P " a t " - 
I E C E CN ο. E “. 6 E D ο PES Ns 
A E . a E E ” ο πλ E n ΓΙ ποσο... 
ae = η SM . ` ο . - E . E -- -.. . » E "EL "- 2 oa - - ου νο 
..--- E ΠῚ - PE E - E - . τς μμ ο τα πι 
A " ~ = n πο . = ον . LL E ΤΩ - "s " - 
"E ae η " ΝΣ E . . à ο ο πο. umm P 
Ρε * " η η = . o . μα ο. E P m 
PIE PEE s . - * ἘΣ Ισ. .. 
E -- E ΠῚ E Li - - E . "m LE E "S ` " 
ο E "n E E Ἢ g B r ο. 
E PC a " «. " L] d - PI = 
d ο rA LI ~ - - Ὁ - * LS -- - A ο... P 
PO E PIE . = - Τη Pr Td Fn 
] E n "T P -. E E ve ο "Ἢ. E MM - φον ΕΠ 
s + E t€ E P Ἢ re να Ὁ τα ΓΩ - E ον “ne 
ΠΠ E = - LE ο "EE pL S -* * "n i ο” 
- .- - LI Li a LI L4 - - . ^ - LI * - LE - or I LI - 
m ο .. E "E 
m" r P E E E . E E 
- . . E - LET * Ld . Ld - LELI 
PLI Li . - . » Lala < τ. * *. 
ΒΗ B E η E H - E E 
- LI E ae . » LI T «i» - * LI 
A = « 2 E ο m ο - ΄ 
aoe "I m .c . Γη 
nr sa " x a e E ο a 
A - a S - E E .. 
- ο - - η = 
po . ο E E η 
» » E E Ἢ . E η 
E E . E E m à κ 
. s PS n E » E - E E 
a - E - E " η 














NAVAL POSTGRADUATE SCHOOL 
Monterey , California 





THESIS 


A HOPFIELD NETWORK APPROACH TO DIRECT 
ADAPTIVE CONTROL OF NONLINEAR SYSTEMS 


by 


Raymond Scott Starsman 


December 1991 


Thesis Advisor: Roberto Cristi 





Approved for public release; distribution is unlimited 


1258734 





UNCLASSIFIED 


Ln n — ——— 


SECURITY CLASSIFICATION OF THIS PAGE 


Form roved 
REPORT DOCUMENTATION PAGE 


la REPORT SECURITY CLASSIFICATION 1b RESTRICTIVE MARKINGS 
UNCLASSIFIED 
2a. SECURITY CLASSIFICATION AUTHORITY 3. DISTRIBUTION / AVAILABILITY OF REPORT 


Approved for public release; 
2b. DECLASSIFICATION /DOWNGRADING SCHEDULE 


distribution is unlimited 
4. PERFORMING ORGANIZATION REPORT NUMBER(S) 






5. MONITORING ORGANIZATION REPORT NUMBER(S) 





6b. OFFICE SYMBOL 
(lf applicable) 


Naval Postgraduate School EC Naval Postgraduate School 
6c. ADDRESS (City, State, and ZIP Code) 7b. ADDRESS (City, State, and ZIP Code) 


6a. NAME OF PERFORMING ORGANIZATION 7a. NAME OF MONITORING ORGANIZATION 






Monterey, CA 93943-5000 Monterey, CA 93943-5000 





8a. NAME OF FUNDING / SPONSORING Bb OFFICE SYMBOL | 9. PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 
ORGANIZATION (if applicable) 








8c. ADDRESS (City, State, and ZIP Code) 








WORK UNIT 
ACCESSION NO. 





10 SOURCE OF FUNDING NUMBERS 
11. TITLE (include Security Classification) 


Ds 
ELEMENT NO [νο NO 
ICONTROL OF NONLINEAR SYSTEMS 


12. PERSONAL AUTHOR(S) 
13a. TYPE OF REPORT 13b TIME COVERED 14. DATE OF REPORT (Year, Month, Day) |15 PAGE COUNT 

| !6. SUPPLEMENTARY NOTATION The views expressed in this thesis are those of the 
author and do not reflect the official policy or position of the Depart- 


17. COSATI CODES 18 SUBJECT TERMS (Continue on reverse if necessary and identify by block number) 
FIELD | GROUP | SU8-GROUP direct adaptive control; nonlinear systems; 
a ne αν 
i 


19 ABSTRACT (Continue on reverse if necessary and identify by block number) 



























An automatic control system capable of controlling an unknown non- 
linear system is designed using a direct adaptive control scheme, imple- 
mented with a Hopfield network. The application of this method to an 
arbitrary system is discussed in detail and three specific simulation 
[studies are included. These studies include the implementation of the 
Hopfield network based direct adaptive control system to a linear system, 
an inverted pendulum, and a nonlinear model of the NPS Autonomous Under- 
water Vehicle (AUV) with six degrees of freedom. The AUV simulation 
includes a three dimensional trajectory following algorithm and shows the 
[ability of the Hopfield network to adapt to simultaneous ordered changes 
in the AUV's depth, speed, and course. 






1 20. DISTRIBUTION /AVAILABILITY OF ABSTRACT 121. ABSTRACT SECURITY CLASSIFICATION 


DE UNCLASSIFIED/UNLIMITED (J SAME AS RPT C DTIC USERS 


22a. NAME OF RESPONSIBLE INDIVIDUAL 22b TELEPHONE (include Area Code) | 22c. OFFICE SYMBOL 
CRISTI, Roberto 408-646-2223 EC/Cx 





| DD Form 1473, JUN 86 Previous editions are obsolete. SECURITY CLASSIFICATION OF THIS PAGE 
S/N 0102-LF-014-6603 UNCLASSIFIED 


| al 


UNCLASSIFIED 


SECURITY CLASSIFICATION OF THIS PAGE 
19. cont. 


Additionally, an analog circuit design is proposed which 
implements the automatic control scheme without the support of a 
microprocessor. The circuit was set up in'SPICE and the simulation 
results as well as some limitations of the analog circuit implementa- 
tion of the Hopfield network are presented. 


DD Form 1473, JUN 86 (Reverse) SECURITY CLASSIFICATION OF THIS PAGE 


UNCLASSIFIED 





1i 


Approved for public release; distribution is unlimited. 
A Hopfield Network Approach 


to Direct Adaptive Control 
of Nonlinear Systems 


by 
Raymond Scott Starsman 
Lieutenant, United States Navy 
B.S.S.E., United States Naval Academy, 1986 


Submitted in partial fulfillment 
of the requirements for the degree of 


MASTER OF SCIENCE IN ELECTRICAL ENGINEERING 


from the 


ABSTRACT 


An automatic control system capable of controlling an 
unknown nonlinear system is designed using a direct adaptive 
control scheme, implemented with a Hopfield network. The 
application of this method to an arbitrary system is discussed 
in detail and three specific simulation studies are included. 
These studies include the implementation of the Hopfield 
network based direct adaptive control system to a linear 
system, an inverted pendulum, and a nonlinear model of the NPS 
Autonomous Underwater Vehicle (AUV) with six degrees of 
freedom. The AUV simulation includes a three dimensional 
trajectory following algorithm and shows the ability of the 
Hopfield network to adapt to simultaneous ordered changes in 
the AUV's depth, speed, and course. 

Additionally, an analog circuit design is proposed which 
implements the automatic control scheme without the support of 
a microprocessor. The circuit was set up in SPICE and the 
simulation results as well as some limitations of the analog 


circuit implementation of the Hopfield network are presented. 


TABLE OF CONTENTS 


I. INTRODUCTION . . . 


II. 


III. 


ADAPTIVE CONTROL 


A. 


B. 


C. 


D. 


A. 


B. 


C. 


PARTIAL STATE REPRESENTATION . . . . . . . . 


DIRECT ADAPTIVE CONTROL 


LIMITATIONS OF DIRECT ADAPTIVE CONTROL .. . 


IMPLEMENTATION OF DIRECT ADAPTIVE CONTROL . . 


THE HOPFIELD NETWORK 


THE PROCESSING ELEMENT 


THE HOPFIELD NETWORK 


THE HOPFIELD NETWORK AS 


THE HOPFIELD 


CONTROL . . . 


NETWORK 


CONVERGENCE AND 


NETWORK... 


1. The effect of T and C on Hopfield network 


convergence 


STABILITY OF THE 


A PARAMETER ESTIMATOR 


FOR DIRECT 


ο e e 9 9 9 9 Ὁ 9 9 e 


2. The Excitation of the Input Signal . . . . 


DIGITAL SIMULATION OF A HOPFIELD NETWORK . . 


l. The Processing Element . . . . è è è è è o 


2. The Hopfield Network . . . . . . è > è > o 


e 


ADAPTIVE 


HOPFIELD 


10 


13 
13 
15 


17 


19 


20 


21 
22 
23 
23 
23 


IV. THE HOPFIELD NETWORK FOR ADAPTIVE CONTROL . . . . . 


V. 


A. 


B. 


C. 


D. 


THE 


A. 


B. 


THE ALGORITHM . . 10 cc cee ne 

l. Determination of the System Order . . . .. 
2. Determination of the Reference Model and the 

Observer . 4. «. 7 9. EE TTE ome 

3. Determination of the Weight Filter Pole . . 
4. Determination of the Input and Output Data 

Filters JC. ο ο ο ου...) 

5. Determination of the Control Signal Filter . 

A LINEAR SYSTEM . . ο ο ο ο ο « © © «© «© © © ο ο 

THE INVERTED PENDULUM . . Ὁ cues 

THE AUTONOMOUS UNDERWATER VEHICLE ...... . 

1. AUV Fundamentals ~~.) . © 9:0 77 7 P 

2. A Control Scheme for the AUV . . . . . . . . 

a. The Path Following Algorithm . . . . « . 

b. A Linear Model of the AUV . . . . . . > 

(1) The Course Rate Controller α. ... 

(2) The Depth Rate Controller . . . . . 

(3) The Speed Controller ....... 

c. Summary of Control . . . >. > è> è> ə > >è > 

3. Limitations of the Control Scheme . « « e à 


4. The AUV Control Simulation . ο ο ο ο ο ο ο 


HOPFIELD NETWORK AS AN ELECTRONIC CIRCUIT . . . 
A SIMPLIFIED FIRST ORDER SYSTEM CONTROLLER . . 


THE FIRST ORDER SYSTEM IN ANALOG HARDWARE . . . 


vi 


25 
25 
26 


27 
28 


28 
29 
29 
34 
38 
38 
39 
40 
43 
44 
46 
48 
49 
50 
50 


59 
59 
63 


C. THE SPICE SIMULATION 
1. The CMOS Op Amp 
CMOS 


2. The Four 


Multiplier . . . 


Quadrant 


Analog 


Voltage 


3. SPICE Simulation of the Hopfield Network . 


D. REMARKS ON THE ANALOG CIRCUIT IMPLEMENTATION 


VI. SUMMARY, 
A. SUMMARY . . . . . è 
B. CONCLUSIONS . . . . 
C. RECOMMENDATIONS . . 


APPENDIX A. MATLAB SOFTWARE 


APPENDIX B. 


TUTSIM CODE . 


APPENDIX C. 


SPICE SOFTWARE 


LIST OF REFERENCES . . .. 


INITIAL DISTRIBUTION LIST . 


vii 


CONCLUSIONS, AND RECOMMENDATIONS 


64 
64 


65 


67 


69 


70 


70 


70 


71 


72 


88 


90 


94 


96 


Table 
Table 
Table 
Table 
Table 


Table 


Direct 
System 
System 


System 


LIST OF TABLES 


Adaptive Control Polynomials . 


Identification of Course Rate Data 


Identification of Depth Rate Data 


Identification of Speed Data . 


Reference Point Schedule . . . ο ο ο 


Waypoints for AUV Path . . . . . ο ο 


viii 


10 
45 
47 
49 
52 
56 


LIST OF FIGURES 


Figure 2-1 - Partial State Representation . . . . . . . 
Figure 2-2 - Direct Adaptive Control System . . . . . à 
Figure 3-1 - A Processing Element . . . . . . . . . . ο 
Figure 3-2 - Sample Transfer Characteristics . . . . . 
Figure 3-3 - Basic Hopfield Net . . . . . . . . . . . . 
Figure 4-1 - Hopfield Net Adaptive Controller . . . . à 
Figure 4-2 - Hopfield control of a Linear System (g, not 
luapbscxle cie) og νο . ο © «© « «© © © ὁ ο 
Figure 4-3 - Hopfield Control of a Linear System (g, 
EG ος ο INE. EN . . s ο ο» ο » © ο 
Figure 4-4 - Hopfield Control of a Linear System (g, 
πες, 1.990 0008 7. . -..ς... ο. ο... ὁ ὁ 9 
Figure 4-5 - Diagram of an Inverted Pendulum . . . « à 
Figure 4-6 - Baseline Convergence of the Inverted 
Pendulum . «ο ο ο ο 9 ο «© © © © © © © © © © © © ο ο 
τε 4—-7 - The NPS AUV ..... « « e o o è o o o o 
Figure 4-8 - Posture Definitions « ο ο ο e è è è « « e 
Figure 4-9 - Course Rate Data and Resultant Models . . 


Figure 4-10 - Depth Rate Data and Resultant Models. . 


Figure 4-11 Speed Data and Resultant Models .... . 


Figure 4-12 - Initial AUV Path Following Simulation . . 


Figure 4-13 AUV Control Parameter Vector . . . . .. 


Figure 4-14 - Improved AUV Path Following Simulation . 


1x 


13 
14 
15 


25 


31 


33 


34 


35 


37 
39 
41 
44 
46 
48 
53 
54 


55 


Figure 4-15 - AUV Traversal of Waypoint Path 


Figure 4-16 - AUV Traversal of Waypoint Path, Following 


Distance Six Feet . . . . . . . . 
Figure 5-1 - First Order 


Controller" "M MM ONNM 


Figure 5-2 - Results of First Order Hopfield Net 


Direct Adaptive 


Figure 5-3 - CMOS Analog Voltage Multiplier . 


Figure 5-4 - SPICE Hopfield Net Output 


Hopfield 


57 


58 


62 
63 
65 
68 


I. INTRODUCTION 

Apart from a few particular cases, no general theory 
exists for the control of nonlinear systems. The simplest 
method for the development of a control system for a nonlinear 
plant is to linearize the nonlinear plant around an operating 
point and derive a linear controller with classical control 
methods. These static control algorithms can control 
nonlinear systems at specific operating points, but may be 
unstable at others. Simple nonlinear systems such as the 
inverted pendulum may have stable linearizations at some 
operating points and be unstable at others. These facts make 
the control of nonlinear systems difficult. 

Adaptive control algorithms hold promise in the control of 
nonlinear systems. Because an adaptive control system changes 
in response to changes in the system, it is able to control 
many nonlinear plants. This thesis investigates the use of a 
Hopfield net for direct adaptive control of a nonlinear 
system. 

An interesting application is the adaptive control of an 
Autonomous Underwater Vehicle (AUV). An AUV is an unmanned 
submersible vehicle designed to operate independently of human 
interaction or support. As such, it must be capable of 
responding to changing, dangerous, or unpredictable conditions 


much as a manned underwater vehicle would. While many of the 


AUV's higher level functions, such as path planning and 
obstacle avoidance, use artificial intelligence techniques to 
cope with different scenarios, the lower level control remains 
unsolved. 

The dynamics of the AUV are highly non-linear and are not 
easily rendered into a satisfactory linear form. These non- 
linearities are particularly evident as the vehicle changes 
speeds. Schwartz investigated the use of recursive least 
squares (RLS) and an adaptive pole placement scheme to control 
the AUV at a given speed (Ref. 1:p. 63]. Although this method 
produced functional results, the intensive calculations 
required by the RLS algorithm would further burden the already 
heavily loaded microprocessor. Since robustness to changing 
plant parameters (due to changing environmental conditions or 
damage) is required, an adaptive controller must be used. As 
the processor aboard is already occupied by the path planning, 
sensor data processing, and navigation software, a solution to 
the nonlinear automatic control problem was sought that 
produces a controller that demands less processor time. 

Neural networks offer a potential solution to this problem 
as there is great promise in the implementation of neural nets 
in analog hardware. The Hopfield network in particular is 
easily realized in analog circuitry. An adaptive controller 
designed using a Hopfield network realized in analog hardware 
would not overload the on-board processor and yet would 


provide the necessary robustness for the control of the AUV. 


The goal of this thesis is to develop an adaptive control 
algorithm based on the Hopfield network and to propose a 
design in analog hardware. 

This thesis is organized in five sections. Chapter II 
describes the direct adaptive control algorithm used 
throughout this thesis. Chapter III contains a description of 
the Hopfield network and its application to direct adaptive 
control. Chapter IV consists of three studies of the 
implementation of the Hopfield network based direct adaptive 
control scheme. Chapter V describes a possible analog circuit 
implementation of this control scheme and discusses some of 
the problems associated with it. Chapter VI provides a summary 
of the results of this work and points out several areas for 


further study. 


II. ADAPTIVE CONTROL 

Adaptive control is a method by which a controller is 
adapted to control an uncertain system in a dynamic operating 
environment. Two major classes of adaptive control exist: 
direct and indirect adaptive control. Direct adaptive control 
is characterized by the direct determination of the control 
parameters from input and output data collected from the 
system. Indirect adaptive control is a two stage process. 
First, system identification techniques are used to obtain a 
model of the system and then standard control techniques are 
used to calculate a controller for the estimated model [Ref. 
2:p. 48]. Indirect adaptive control is generally slower than 
direct adaptive control and requires greater hardware support 
and/or computational effort. In this thesis only direct 


adaptive control is considered. 


A. PARTIAL STATE REPRESENTATION 

In order to proceed with the derivation of the direct 
adaptive control algorithm, it is necessary to introduce an 
alternate representation of a system called the partial state 


representation [Ref 3:p. 209]. The system 


y(t) = BE). ae) (2-1) 
A(s) 





where s can be interpreted either as the differential operator 


or the complex variable of the Laplace transform and 
A(s) = s"+a,s"°+...+a;  B(s)=s"+b s™*+...+b (2-2) 


can be broken into two components as shown in Figure 2-1. 





Figure 2-1 - Partial State Representation 


The intermediate state z(t) is called the partial state and 


the system of equation (2-1) is equivalent to 


A(s)z(t) 
y(t) 


u(t) 


2=3 
B(s)z(t) — 


The partial state representation is useful in the derivation 


of the direct adaptive control algorithm. 


B. DIRECT ADAPTIVE CONTROL 

As stated earlier, direct adaptive control uses the input 
Signal to a system and the output signal from a system to 
directly determine suitable control parameters. For this work 


a pole placement scheme is employed, meaning that the system 


output y (ia is 
controlled to react to 


the reference signal 


7 
- t Unknown 
p 
v(t) as does the 
reference model with the 


Control Parameter 
Identifier 


transfer function 


this), kis), 8,1 
l/p'(s). A block diagram 





of a direct adaptive L- - - 
Figure 2-2 - Direct Adaptive 
control system is shown Control System 
in Figure 2-2. In this diagram, the control parameter 
identifier receives data from the input and output of the 
system and uses this data to modify the controller. 
Assuming the unknown plant can be modeled as a piecewise 


linear system, then it may be described at any given operating 


point by the linear differential equation: 


y(t) = El u(t) (2-4) 
p(s) 


where p(s) is an N^ order monic polynomial and r(s) is an Mf 
order stable polynomial, meaning that the roots of r(s) are 


all in the left half-plane. Rewriting equation (2-4) in 


partial state form yields: 


p(s)z(t) 
y(t) 


ut) 


r(s)z(t). πο 


The goal of the controller is to track the output of a 
reference model driven by an external input v(t), specifically 


1 


P (s) 


Y.(t) = v(t) (2-6) 





where p'(s) is the characteristic polynomial of the reference 
model and y,(t) is the reference model output. From the pole 


placement problem the control input has the following 


structure 


a ἡ (5 SE ut) ege: *v(t) (2-7) 
α(5) q(s) 


u(t) Ξ 


where the observer polynomial q(s) is an arbitrary N^ order 
stable monic polynomial, h(s) and k(s) are the unknown control 
polynomials of order N-1, and g, is the input gain [Ref 4:p. 
5]. Multiplying both sides of equation (2-7) by q(s) and 
substituting for y(t) and u(t) from the partial state 
equations (2-5) yields the closed loop dynamics 


q(s)p(s)z(t) = h(s)r(s)2z(t)+k(s)p(s)2(t) + 


2-8 
g.q(s)v(t). E^ d 


The polynomials h(s) and k(s) are defined to satisfy the 


following condition: 


q(s)p(s)-k(s)p(s)-h(s)r(s) - Lp'(s)r(s)q(s). (2-9) 
I 


1 


Equation (2-9) can be put into the form of the Diophantine 


equation [Ref. 2:p. 291] after some simple rearrangement: 


h(s)r(s)+k(s)p(s) = q(s) (p(s)-—p"(s)r(s)) (2-10) 
r 


1 


where r, is the coefficient of the highest order term of the 
plant numerator polynomial. If the system (p(s) and r(s)) 
were known, then the polynomials h(s) and k(s) could be solved 
for directly using the Sylvester matrix [Ref. 2:p. 295]. The 
MATLAB subroutine FIND HK.M was written to solve the 
Diophantine equation and return a solution for h(s), k(s), and 
g,. This subroutine can also be used to determine initial 
estimates of the coefficients of h(s), k(s), and g, for a 
linearized model of a nonlinear system. The subroutine is 
included in Appendix A. 

Assuming the estimates of h(s) and k(s) converge to the 


solution of the Diophantine equation, then the closed loop 


partial state equations of the controlled system become: 


p». (2-11a) 
—p (s)q(s)r(s)z(t) -ggq(s)v(t) 
I 


1 


y(t) » r(s)z(t). (2-11b) 
Eliminating the partial state variable, z(t), setting g, to 


l/r,, and dividing both sides of equation (2-11a) by q(s) 


yields the desired closed loop dynamics: 


1 
P'(s) 


CC) 





v(t). (2-12) 


This transfer function is identical to equation (2-6) and thus 
the closed loop system now responds to the input v(t) as would 
the reference model given by p'(s). The challenge remains to 
find the polynomials h(s) and k(s) and the gain g, that 
satisfy equation (2-9) given only the input and output data of 


a system. 


C. LIMITATIONS OF DIRECT ADAPTIVE CONTROL 

The preceding formulation of a direct adaptive control 
scheme required several assumptions which are summarized in 
Table 2-1. Of note is that the unknown plant need not be 
stable, but must be minimum phase. Because r(s), the unknown 
plant numerator polynomial, is essentially canceled out by the 
denominator of the controller, any unstable roots of r(s) make 
the closed loop system internally unstable (Ref. 2:p. 440]. 


It should also be noted that a good estimate of the number of 


poles N and zeros M of the unknown system must be known in 


order to choose properly sized qí(s) and p'(s) polynomials. 


Polynomial Order Must be stable? 
p(s) N mM No 


r(s) 


P (s) 


q(s) 
h(s) 
k(s) 





Table 2-1 - Direct Adaptive Control Polynomials 


D. IMPLEMENTATION OF DIRECT ADAPTIVE CONTROL 

The traditional method of implementing the above direct 
adaptive control scheme is to use a recursive least squares 
algortihm to estimate the parameters h(s), k(s), and g, [Ref. 
2:p. 440]. To put this problem into regression form, both 


sides of equation (2-7) are multiplied by q(s) yielding: 
q(s)u(t) » h(s)y(t)*k(s)u(t)*g q(s)v(t). (2713) 
Equation (2-12) can be rewritten as: 
v(t) » p'(s)y(t)- (2714) 


Substituting for v(t) from equation (2-14) in equation (2-13) 
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yields 


q(s)u(t) » h(s)y(t)*k(s)u(t)*g q(s)p'(s)y(t). (2-15) 


Equation (2-15) can now be written in regression form 


πιο) ΟΕ] (2-16) 
where 
E SERE) 
Ay y(t) $ 
-17 

x(t) =q(s)u(t); 8 =|K,|; $(t) = s"u(t) E / 

κ u(t) 

g p’(s)q(s)y(t)] 


P 


Since x(t) and $(t) are known, the least squares estimate 


of 0 is expressed as [Ref. 5: p. 324] 


^ argmin 


= 2-18 
0 Oocmp?^? Iz (e)] ( ) 

where 
J(80) = [e tx (e) -8"6 (c) l'a. (2-19) 


0 
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The value for Ó is recursively estimated as 


P(kT.)ó(kT ) [x(kT,) -$&^(kT )Ó(XkT.)] 


Ô (kT +T) 
1+$7(kT,)P(kT,) $(KT,) 


6(kT_)+ 
(2-20) 


P(kT )ó(kT. ) 9^ (kT ) P(XT.) 
P(kT +T) noo a e M ας 


P(kT_)- 
1+$7(kT,)P(kT_)$(kT,) 


based on samples taken at a rate of 1/T, samples per second 
[Ref. 5:p. 325]. Although the RLS method converges to a 
correct estimate of 0, it requires extensive and intensive 
calculations, consisting of several matrix multiplications and 
scalar divisions at every iteration. Furthermore, this 
process would be difficult to implement in analog hardware 
because of the number and the nature of the required 


operations. 
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III. THE HOPFIELD NETWORK 


A. THE PROCESSING ELEMENT 

The processing element is the heart of any neural network 
and was conceived as a coarse analogy to the biological neuron 
[Ref. 6:p. NC-4]. A diagram of a typical processing element 


is shown in Figure 3-1. 





Figure 3-1 - A Processing Element 


The processing element consists of three major parts: the 


input weights t,;; the summing junction; and the transfer 


characteristic g(*). The inputs x; are either external 
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signals or signals from other processing elements. The neural 
network is defined by its structure and the values of the 
weights. The summing junction simply sums the weighted inputs 
as well as the weighted bias signal c; and passes the result 
u; to the transfer characteristic (Ref. 6:p. NC-5]. Figure 3- 


2 shows several samples of possible transfer characteristics. 


Sigmoid 


Saturotion 





Figure 3-2 - Sample Transfer Characteristics 


The transfer characteristic is usually a monotonically 
increasing nonlinear function such as a sigmoid or a 
hyperbolic tangent [Ref 7: p. 40]. 

Neural networks are typically constructed by arranging 


processing elements in layers and interconnecting the layers. 
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B. THE HOPFIELD NETWORK 
The Hopfield network consists of a single layer of 
processing elements that are completely mutually 


interconnected (Ref. 8:pp. 96-99]. A generic Hopfield network 





Figure 3-3 - Basic Hopfield Net 


is shown in Figure 3-3. The Hopfield network uses a version 
of the processing element introduced in the previous section 
modified by the addition of an integrator at the output of 


eth 9 9 9 
each neuron. Thus the i neuron in a continuous Hopfield 
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network of n elements evolves as: 


n 
d, - E tvc, (3-1) 


where v;=g(u;), g(°Ħ°) being the monotonically increasing 
transfer characteristic. Arranging the neuron states v, into 
vector V, the weight coefficients t,,; into matrix ΤΙ, and the 
bias weights c, into vector C, the equation for the entire 


Hopfield network becomes 


U = TV+C (3-2) 
where 
tu Ch U tu zm 
T - tj Cn ~ ©, : C= C; (3-3) 
tu t bi t ο] 


An energy function is defined for the Hopfield network of 


equation (3-2) as 
E(t) » -lV'Tv-C'v (3-4) 
2 


Hopfield has shown that if T is negative definite and 
symmetric, then the energy function, E(t), tends to a minimum 


[Ref. 8: p. 99]. This is shown by taking the time derivative 
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of equation (3-4) along the trajectory of the network: 
TE -ἂν mv-iv'rv-c"V. (3-5) 
Since T is symmetric, equation (3-5) is simplified to: 
E(t) - -V'TV-C'V 


-(VTT«CT")V (3-6) 
-V (TV«C). 


The definition of the Hopfield network given in equation (3-2) 
is substituted in equation (3-6) yielding the time rate of 


change of the Hopfield network energy as 


É(t)s-V Ú. (3-7) 


Rewriting equation (3-7) in terms of the summation definition 


of equation (3-1) yields 


É(t) - -Yig'(u,)u;. (3-8) 
j=l 


Since g(*) is monotonically increasing, its derivative, g'(e*), 
must always be nonnegative. The second term in the summation, 
u,*, is also always Jnari ve Since the derivative of E(t) 
is always nonpositive and E(t) is lower bounded, it must tend 


to a minimum. 


C. THE HOPFIELD NETWORK AS A PARAMETER ESTIMATOR 
The energy or cost function of the Hopfield network has 


been shown to have a finite minimum. Thus for any given set 
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of connection weights T and biases C the output of the 
Hopfield network V converges to a minimizing solution. This 
behavior is analogous to the recursive least squares algorithm 
whose cost function was defined in equation (2-19). The cost 
function J(0) of equation (2-19) is expanded to 
t 
J(0) - [e^ x(t) de 
: (3-9) 
t t 
0 fet Poleg code 0-2 [exce (co)acp. 
0 0 
As the first term is not a function of 0 it has no effect on 


the minimization of Ó and may be discarded. Thus an 


equivalent cost function for RLS estimation is: 


t t (3-10) 
J(0) 20 Jew o( x) g(t) de 0-2 [ο κιτ) g(t) de 6. 


0 0 
A comparison between the Hopfield network energy function, 
equation (3-4), to the simplified RLS energy function, 
equation (3-10), enables certain equivalencies to be made. 


Setting the Hopfield network output V equal to 0, the 
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following equations must be true: 


T - - [eec ϕ” (τ) ἂτ 
a (3-11) 
- [e x(t) 9 (tae. 


0 


C 


Thus if the Hopfield network weight matrix and bias vector are 
set according to equation (3-11), the Hopfield network output 
will converge to the optimal estimate for @ as would the RLS 


algorithm. 


D. THE HOPFIELD NETWORK FOR DIRECT ADAPTIVE CONTROL 

As shown above, the Hopfield network will provide an 
optimal estimate of Ó provided that T and C are formed as per 
equation (3-11). Equation (2-17) specifies the formation of 
@(t) as a vector of y(t), N-1 derivatives of y(t), u(t), N-1 
derivatives of u(t), and the scalar p'(s)q(s)y(t). However, 
these derivatives may not be directly available to the control 
parameter identifier. Furthermore, analog differentiation is 
not a reliable operation in a real world environment as 
differentiators are ΠΠ σπιν subject to noise (Ref. 9:p. 99]. 
Rather then using the direct adaptive control equation 


directly, both sides of equation (2-15) may be operated on by 
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l/p'(s)q(s) yielding 


αι NECS LL 
p'(s)q(s) P'(s)q(s) (3-12) 


k 
Salam u(t)+g y(t). 
p'(s)q(s) 


Equation (3-12) shows that y(t) and u(t) may be filtered by 
l/p'(s)q(s) and the resultant control parameters h(s), k(s), 
and g, remain the same. When y(t) and u(t) are properly 
operated on by a state space filter in controllable canonical 
form, the necessary derivative states are available without 


the need for a differentiator. 


E. CONVERGENCE AND STABILITY OF THE HOPFIELD NETWORK 

As mentioned earlier, the Hopfield network based direct 
adaptive controller will converge to an optimal estimate of @. 
The particular transfer characteristic g(:) has no effect on 
the steady state value of Ó unless one or more of the actual 
elements of 0 exceed the bounds of the nonlinearity. It is 
the responsibility of the designer to ensure that all 
controller parameters are within the bounds of the transfer 
characteristic. 

This implementation of the Hopfield network attempts to 
operate the neurons in their linear region. Therefore, the 
terminology Hopfield network rather than neural network is 


more appropriate to this implementation. 
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1. The effect of T and C on Hopfield network convergence 
Assuming that the Hopfield network output 6 does not 

exceed the bounds of the nonlinearity, then the Hopfield 
network output states behave as a linear system response to a 
step input where T is analogous to the continuous time A 
matrix and C is analogous to B. The steady state value of ô 
is -T^C and the speed of the convergence is proportional to 
the eigenvalues of T. In order to speed convergence it is 
desirable to keep the eigenvalues of T as large as possible. 
There are several methods to speed the convergence of the 
Hopfield network. The first is to be aware of the operating 
conditions of the plant in its likely area of operation. The 
rate of convergence of the algorithm is determined by the 
eigenvalues of T, and therefore by the magnitude of y(t) and 
u(t). If these signals are small enough to affect the rate of 
convergence then they can be properly scaled to increase the 
eigenvalues of T. The next method is to increase both T and 
C by a scalar positive constant A. This does not change the 
steady state value of @ but it does increase the eigenvalues 
or T. In a digital simulation the use of A is almost 
unrestricted, however in an analog implementation its value is 
limited by the voltage and current capacities of the 


components and the noise level. 
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2. The Excitation of the Input Signal 

The nature of the input signal v(t) is critical to 
parameter convergence. The signal v(t) must provide 
persistency of excitation in order to guarantee convergence of 
the parameters.  Persistency of excitation is related to the 
frequency content of the signal [Ref. 5:p. 423]. For example, 
a sinusoid would not be persistently exciting for a system of 
order greater than two in the sense that it does not contain 
enough information to estimate the parameters. When an input 
signal is not persistently exciting, the eigenvalues of the T 
matrix tend to become small, slowing the Hopfield network 
convergence. Based on frequency content alone, the best input 
for persistent excitation is a white noise signal. However, 
white noise signals are not well suited for systems with small 
bandwidth. Since white noise is typically zero mean, a system 
with small bandwidth filters the white noise to a very small 
zero mean signal yielding a T matrix with very small 
eigenvalues. A superior input signal for use in these systems 
is a square wave of frequency suitable to the system since the 
square wave concentrates its energy in a finite bandwidth, 
whereas a white noise signal has an evenly spread power 
spectrum. The period of the square wave should be determined 
to ensure that it is suited to both the reference model and 


the plant. 
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F. DIGITAL SIMULATION OF A HOPFIELD NETWORK 
1. The Processing Element 

The processing element is most easily represented in 
software as a single-input single-output system. The input is 
the sum of the product of the weights and the inputs to the 
neuron added to the bias term. The output of the neuron is 
simply the output passed through the transfer characteristic. 
This work will consider four different transfer 
characteristics: 1) the sigmoid, 2) the hyperbolic tangent, 3) 
the identity (a linear neuron), and 4) a saturation 
nonlinearity. It should be noted that all four of these 
transfer characteristics are monotonically increasing. The 
subroutine that applies the nonlinearity to the neuron input 
is called SIGMOID.M and is included in Appendix A. 

2. The Hopfield Network 

Having implemented the neuron, the implementation of 
the Hopfield network is a matter of implementing the nonlinear 
differential equation that describes a Hopfield network given 
in equation (3-2). The function that iterates a Hopfield 
network over one sampling period is described below; the 
corresponding MATLAB function is included in Appendix A as 
HOPFIELD.M. If the neuron is linear (case 3 above), then U=V 
and equation (3-2) becomes a simple state space linear 
differential equation and may be simulated in a single time 


step by converting the continuous model to a discrete model 
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and iterating the discrete model by one time step. The value 
returned is the Hopfield network output at the next time step. 

The nonlinear neurons are not as simple. The MATLAB 
routine ODE45 was written to solve a nonlinear differential 
equation written in state space form [Ref 10:pp. 3-137 to 3- 
139]. This routine was modified to operate directly on the 
Hopfield network nonlinear differential equation (3-2). The 
only problem with this method is its computational complexity 
with respect to the linear method. The sigmoidal and 
hyperbolic tangent Hopfield networks were simulated in this 
manner. 

The saturation nonlinearity Hopfield network was 
implemented similarly to the linear problem. The Hopfield 
network was determined for one iteration as described for the 
linear case. Following that solution, the output was passed 
through a saturation nonlinearity. Although this was not 
strictly the solution to the nonlinear differential equation, 
it was a very close approximation. If the sampling time was 
sufficiently small, the solution arrived at through this 
simplified method was indistinguishable from that arrived at 
via the more complex ODE45 solution and there was more than a 


fifty fold savings in simulation time. 
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IV. THE HOPFIELD NETWORK FOR ADAPTIVE CONTROL 


A. THE ALGORITHM 
The implementation of the Hopfield network for direct 
adaptive control is reasonably straightforward. A schematic 


of the Hopfield network controller is shown in Figure 4-1. 


u(t)|| Unknown | y(t 
Plant 


Generate T and C 


E 
Form $(t= 
[$0 xt) Ht); AMC) Acts AC) yt) 
I ΚΕ; 

Ν E | 

Yields &(t)=[h(e); k(e); g] ij ὠς 


Jel 


Hopfield Net 


Form ¥(t)}= 
[ y^ (0--(tx y(0; ü"*(t)--3(0;u(0;w(0] 





Figure 4-1 - Hopfield Net Adaptive Controller 


The first step towards the eventual implementation of the 
Hopfield network controller in hardware was a high level 
software simulation. This simulation was intended to give 


insight into the behavior of a system controlled by a Hopfield 
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network as well as to discover any potential difficulties 
inherent in this control implementation. The high level 
simulations were written in MATLAB. The next few sections 
describe the general steps in the implementation of the 
Hopfield network for direct adaptive control. 

l. Determination of the System Order 

An estimate of the system order N and the number of 
system zeros M must be determined. There are a variety of 
methods available to the designer, from complex systems 
identification tools to a simple educated guess. 

An important note in the determination of the system 
order is a caution about the modeled system zeros. If the 
optimal plant model with N poles and M zeros at a given 
operating point has unstable zeros, then the closed loop 
system will not be stable at that point. In a linear system 
this implies instability, whereas a nonlinear system may 
transit to an operating region with stable zeros and oscillate 
around the unstable operating point. One possible method to 
control this plant is to use a plant model (N and M) of lower 
order than the one determined above. For example, if a third 
order linear plant with one unstable zero (N23, M-1) were 
controlled by this direct adaptive control algorithm, it would 
be unstable. However, if the direct adaptive controller were 
designed with the assumption that the plant was third order 


with no zeros (N=3, M=0), in some cases the closed loop system 
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would be stable because the unstable zero would never be 
canceled. Of course, this reduced form cannot model the 
unknown system as well as the full model thus reducing the 
accuracy with which the controller can follow the reference 
model. The accuracy with which a plant can follow the 
reference model is largely determined by how closely the 
reduced order optimal model matches the actual system. 

2. Determination of the Reference Model and the Observer 

The choice of the reference model, p'(s), is clearly 
critical to the closed loop system performance. Since it is 
desired that the closed loop system behave as the reference 
model to the input signal, a reference model must be chosen 
that exhibits the desired response. For this work we chose as 
reference models the class of Butterworth filters. The 
bandwidth w, is chosen according to the desired speed of 
response. This reference model exhibits fast rise time with 
small overshoot. 

The observer qí(s) was chosen in accordance with 
traditional control theory. A fast observer (one with very 
large poles) is not necessarily good because it will follow 
the noise as well as the signal [Ref. 5:p. 260]. As a rule of 
thumb, it is a good choice for the observer polynomial to have 
four times the bandwidth of the reference model. In this 
thesis the observer was chosen as a Butterworth polynomial 


with bandwidth 4o,. 
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3. Determination of the Weight Filter Pole 

The weight filter a/(sta) is associated with the 
forgetting factor used in the calculation of T and C. The 
value of a is an important factor in the speed of convergence 
of the Hopfield network. For linear systems, the Hopfield 
network converges faster when a is made smaller. However, 
experimentation has shown that if a is decreased much beyond 
the slowest root of the plant, the speed of convergence will 
remain about the same. Thus a good choice for a for the 
control of a linear or nearly linear plant is the magnitude of 
the slowest root of the plant. 

The choice of a in a nonlinear plant is somewhat more 
difficult. For many nonlinear plants the above guideline for 
linear plants for choosing a is still valid. However, if the 
plant linearization changes more rapidly than the slowest root 
of the linearization, then a should be chosen to be somewhat 
larger. This increases the ‘forgetting factor' of the 
Hopfield network's weights, allowing the network to 
concentrate on the more recent inputs to the system and forget 
about the older, less valid data. 

4. Determination of the Input and Output Data Filters 

The filter for the input u(t) and output y(t) data is 
determined as shown in equation (3-12). Two vector variables, 


$,(t) and $,(t), are formed by filtering y(t) and u(t) through 
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a filter with dynamics 1/p,(s)q(s) in controllable canonical 


form: 
Seit) S ut) 
$ (t) = ; 0 $(t)- 2) 
sy,(t) su,(t) 
y,(t) | πμ. 
where 
yt) - — lil y(t); u(t) = — | u(t). (4-2) 
p'(s)a(s) P'(s)q(s) 


5. Determination of the Control Signal Filter 
The control system output from the Hopfield network 
based direct adaptive controller is given in equation (2-13). 


Both sides may be divided by σ(5) to yield the control signal 


h k 
(8) y(t) +22) u(t) +g vit) (4-3) 
α(5) q(s) 





u(t) - 


where h(s), k(s), and g, are the components of the parameter 
vector Ó. Therefore, y(t) and u(t) must be filtered by 1/q(s) 
in order to generate the control signal. This is done as 


before, with two 1/q(s) state space filters in controllable 


canonical form. 


B. A LINEAR SYSTEM 
Before proceeding to nonlinear systems, some basic tests 


of the Hopfield network based direct adaptive controller were 
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made on a linear system. The linear system chosen was a third 
order pitch and depth model of the AUV. The state space form 


of this system is 


αΙ |-0.07 -0.04 Olq| |1 

yl= 1 0 Ojy|*[jOju(t) (4-4) 

Z 0 -0.12 Ojz| !O 
where q is the pitch rate, y the pitch, and z the depth of the 
AUV [Ref. l:pp 27-30]. It is desired to control the depth 
state to match a reference model's response to an external 
input v(t). Figure 4-2 shows plots of the baseline run with 
the T and C filter pole a set to one radian per second, and A 
set to one. Figure 4-2a shows the reference model's and the 
actual system's response to the input signal. Figure 4-2b is 
an expanded view of the portion of Figure 4-2a outlined by the 
box. Clearly, this is not a satisfactory control as the 
output does not follow the reference model. The problem stems 
from the fact that the Hopfield network estimation of g, drops 
to nearly zero, and because g, is the coefficient that 
amplifies the input signal v(t), this reduces the magnitude of 
the input to the plant. The reduction of input yields a T 
matrix with extremely small eigenvalues, slowing convergence 
of the Hopfield network to a glacial pace. 

The solution to this problem is to prevent g, from falling 


below a certain threshold. The threshold value may be 
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Figure 4-2 - Hopfield control of a Linear System (g, not 
limited, A=1) 


determined by using system identification routines to estimate 
a model for the unknown system. Noting that g, is equal to 
1/r,, where r, is the highest order numerator coefficient of 
the unknown system, the threshold value may be some fraction 
of the estimate of g, or B/r,. The value of B is set according 
to the confidence in the estimate of r,. A B of one implies 
absolute confidence that the actual g, is no lower than the 
estimate. A B of between 0.1 and 0.5 is more realistic as it 
allows some room for error in the initial estimate of g,. 


Nonlinear systems should have B in this range because the 
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estimate of r, may change over time. In practice the value of 
B has little impact on the convergence as long as it is 
reasonably large but does not exclude the actual value of r, 
from consideration by the Hopfield network. For the next run 
of the linear system the Hopfield network estimate of g, was 
limited to 0.2g, where g, was found with the routine FIND _HK.M. 
The rest of the system parameters remain the same as the 
previous run. Figure 4-3a shows the reference model output 
and the actual plant output due to the input signal v(t) and 
Figure 4-3b shows an expanded view of the outlined area of 
Figure 4-3a to more clearly demonstrate the plant convergence. 
It is notable that just prior to the Hopfield network 
convergence, the AUV's depth state became very large and this 
is what caused the convergence to occur so abruptly. Figure 
4-3c shows a plot of the parameter vector ϐθ versus time. This 
plot shows that the parameter vector converges’ in 
approximately 45 seconds. 

The final simulation that was run on the linear plant was 
to demonstrate the effect of increasing A to 1,000,000. The 
g, threshold was left in place as it is still required for 
rapid convergence. Figure 4-4a shows the reference model and 
the actual model and Figure 4-4b expands the outined area of 
Figure 4-4a and shows that the actual output does converge to 
the output of the reference model. It is again noted that the 


AUV dropped to a large depth value before the parameter vector 
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Figure 4-3 - Hopfield Control of a Linear System (g, limited, 
A=1) 


converged. However, the depth excursion in this case is about 
100 times less than in the previous simulation. The lower 
left plot is that of the parameter vector and shows that the 
parameter vector converges in about 10 seconds. This is a two 


fold improvement over the previous case where A was unity. 
This is as expected because the increase in A increased the 
eigenvalues of the T matrix and thus the convergence of the 
Hopfield network. Although the use of 4 is practically 


unrestricted in a digital simulation, it is limited by the 
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Figure 4-4 - Hopfield Control of a Linear System (g, limited, 
A=1,000,000) 
available voltage and current magnitudes in an analog circuit 


implementation. 


C. THE INVERTED PENDULUM 

The inverted pendulum was used as an initial test of the 
nonlinear direct adaptive Hopfield network controller. A 
simple model will be used with the pendulum swinging on a 
stationary axis and a control torque applied at the axis. 


Figure 4-5 shows this system. The nonlinear differential 
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Figure 4-5 - Diagram of an Inverted Pendulum 


equation that describes this system is 


b EE υ 


ml? ml’? 


y-—':siny- 








[ta 


(4-5) 


where b is the frictional coefficient, m is the mass of the 


pendulum and 1 is the length of the weightless arm. 


The goal 


of the control effort will be to maintain the position of the 


pendulum in a relatively upright position (y=0). 


upright position the system of equation (4-5) may be 
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In this 


linearized by letting sin(y)=y which yields 








1 
n2 
Υ(5) m (261 
Bs R9 
ml? 1 


This linearization shows that the system order N is two, the 
number of zeros M is zero, and that the system is unstable at 
this operating point. The file PEND.M is the driver file for 
this problem and is included in Appendix A. 
For this study the following values were used: 

m=.1 kg; b=1 kg-m /s; 1-1 πι. The elements of parameter vector 
0 were initialized to 0.1. The sampling time for these 
simulations was 0.1 s. The reference model was an (N-M)* 
order Butterworth filter of bandwidth 1 r/s. As discussed 
earlier, the observer was chosen as an Nt? order Butterworth 
filter of frequency 4 r/s. The pole of the filter for T and 
C was 1l r/s. The input signal was a square wave of magnitude 
0.1 and frequency 0.1 r/s. The pendulum simulation was run 
with ἀΞ-16χ105, The large value for A was required to speed 
convergence to a reasonable amount of time. Figure 4-6a shows 
a plot of the pendulum angular position in radians, Figure 4- 
6b shows a plot of the control input u(t), Figure 4-6c shows 
the time history of the Hopfield network output Ó(t), and 
Figure 4-6d shows the plot of the reference signal v(t), the 


reference model response to v(t), and the actual output of the 
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Figure 4-6 - Baseline Convergence of the Inverted Pendulum 


system. The convergence of 6(t) is clearly evident in this 
figure. The last plot also shows that the system output 
converges to the reference model output as desired. 

Several other Hopfield network control simulations were 
attempted on the inverted pendulum with mixed results. In 
cases where the pendulum fell upside down, the Hopfield 
network had difficulty in restoring the pendulum to an upright 
position. The problem lies in the fact that this is a model 
based implementation and that the Hopfield network must be 
able to adjust its weights as quickly as the system changes 


its linearization. 
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D. THE AUTONOMOUS UNDERWATER VEHICLE 
1. AUV Fundamentals 
The model of the AUV that was used in this study is 
that of the seven foot NPS AUV [Ref 11] written in C and 
compiled for use in MATLAB [Ref. 12:pp. 124-129]. The model 
is nonlinear with six degrees of freedom, 12 states, and 5 


inputs. The 12 states are: 


u surge (longitudinal speed) 
ν sway 

W heave 

p roll rate 

q pitch rate 

r S yaw rate (4-7) 
x X 

y Y 

Ζ Z (depth) 

$ roll 

0 pitch 

Uy yaw (course) 


The five inputs are: the stern and bow rudder angles, the 
stern and bow planes, and the shaft RPM. A diagram of the AUV 
is shown in Figure 4-7. 

The high level control effort envisioned for the AUV 
is to control the posture of the vehicle (the posture is made 


up of the course, the x and y position, and the depth) to 
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Figure 4-7 - The NPS AUV 


follow a reference posture. For simplicity, the stern and bow 
actuators were treated as one control input, with the bow 
actuator receiving the negative of the signal sent to the 
stern actuator. 
2. A Control Scheme for the AUV 

Because the AUV is a multiple-input multiple-output 
nonlinear system, the control scheme is complex. The upper 
layer of control is the path-following controller which 
receives as input the posture of a reference point and the 
AUV, and outputs AUV state reference signals for use by the 


low level controller. The low level controller receives the 
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state reference signals and determines the appropriate control 
force to apply. 
a. The Path Following Algorithm 

Although the path following algorithm is not a 
major issue in this work, it is included as a possible high 
level AUV control algorithm. The control scheme implemented 
in this model was a three dimensional extension of the two 
dimensional path following algorithm described by Kanayama et 
al [Ref 13:pp. 384-389]. The path following algorithm 
compares the AUV's posture with that of a reference posture 
and determines suitable state reference signals to maintain 
the AUV on the reference path. A pictorial description of the 
postures is shown in Figure 4-8. 

The AUV is controlled by ordering the course rate, 
depth rate, and forward speed determined by the path following 
algorithm from the reference posture and the posture error. 
The path following algorithm produces three command signals 
based on the error posture between the actual vehicle and a 


reference model: 


U eemmand u COS V, +K. 
D small = Iet ref ( Ky, +K s iny, | ( 4 - 8 ) 
command A +K Z, 
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Vehicle 
Posture 





Reference (2.2) 
Posture 
Depth Rate Z. 
Vehicle 
Posture Gas) 
Depth Rate 


Depth 


Figure 4-8 - Posture Definitions 
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where the error posture is 


^e cosy sinp 0 0|*zer * 
Ve -si να. E 
7 siny cosy 0 0 f (4-9) 
y. 0 0 1 Ο]ψ ,-y 
Ζ, 0 0 0 1 Z Z 


It should be noted that the third command is depth change rate 
and not the heave of the vehicle and therefore it is not a 
state of the AUV model. This signal may be calculated 


analytically as 


Z - -u sin0-w cosOsinó-*v cos0cosó (4-10) 


or readily estimated as 


z(kT ) -z(kT -T ) 
Z(kT ) = ————————— (4-11) 
T 


where T, is the sampling interval. The goal of the control 

system is to follow the three command signals given in 

equation (4-8) by properly adjusting the control inputs. 
When the heading error is much less than one radian 


the coefficients K,, K 


y K,, and K, may be interpreted and 


determined in the following manner. 1/K, is the time constant 


for the correction of the position error along the AUV's 


longitudinal axis.  K, and K, are related coefficients that 


determine a second order transfer function of the error 
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resolution across the  AUV's longitudinal axis. The 


differential equation for the cross range error is 
y*Kv. YHK Viy =O . (4-12) 


Assuming the desired transfer function is to be critically 


damped, then K, and K, are related as 


K,=2/K, (4-13) 


Lastly, 1/K, is the time constant for the correction of the 
depth error. 
b. A Linear Model of the AUV 

There are three system outputs that are 
controlled by the  path-following algorithm described 
previously. The surge of the vehicle is controlled by the RPM 
command input while the depth rate is controlled by the stern 
and bow planes and the yaw rate by bow and stern rudders. The 
system order N, the number of zeros M, and an estimate of the 
gain r, must be known for each of the three sub-systems before 
proceeding with the Hopfield network control system. These 
values were estimated by generating an input and corresponding 
output sequence for each of the sub-systems and using a system 
identification routine to estimate a linear model for the sub- 
system. The routines used to determine the system model were 


GET MOD.M and FIND MOD.M included in Appendix A. 
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(1) The Course Rate Controller 

An input signal for the rudders was generated 
as a square wave of magnitude 0.4 radians and frequency 0.075 
r/s with the vehicle travelling at 2 ft/s. The input signal 
was applied to the AUV model and the course rate output was 
observed. Figure 4-9a shows a plot of the input/output data 
used to determine a linear model of the rudder to cous rate 
transfer function. Figures 4-9b and c present comparisons of 


the two best models. A summary of the results of the 


input ond Output Doto 


(c) 02 





Figure 4-9 - Course Rate Data and Resultant Models 


system identification are shown in Table 4-1. Table 4-1 shows 


that the mean absolute state error for the first order system 
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is the second lowest. A 
third order ayston with [W] rem me rn 


0.0095 





two zeros had the 
oo 
smallest error. Figures 0.0148 





ο 
ο 


0.0060 










4-9b and c show a 

comparison between the 

first order model and the 
Table 4-1 - System Identification 

third order model. of Course Rate Data 

Although the third order 

model is more accurate, the first order model is satisfactory. 

This reduction of model order significantly reduces the size 

of the computational problem because the size of the T matrix 

and thus the size of the Hopfield network varies as (2N*1)*. 


The transfer functions of the first and third order models of 


the AUV's course rate state were estimated as 


dee s. S) "νο 7 
r = 0.16 =a (4-14) 
UMS) s+0.499 
and 
MEC .α 2-0. -0.01724 
ἘῸΝ ο 0.1875s^-0.10215s-0.0172 (4-15) 


U udder (>) s?+1.313s7+0.3859s+0.05419 
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(2) The Depth Rate Controller 
A square wave of amplitude 0.4 radians and 
frequency 0.025 r/s was applied to the dive planes with the 
vehicle travelling at 2 ft/s. The resultant depth rate as well 


as the input signal are shown in Figure 4-10a. 


Input/Output Depth Doto 


100 150 
Figure 4-10 - Depth Rate Data and Resultant Models 





The output data suggests that the system is first order. The 
input and output data used with the system identification 
routine GET MOD.M and the results are shown in Table 4-2. A 
graphic comparison of the first and fourth order model is 
shown in Figures 4-10b and c. Again the first order model has 


the second smallest summed absolute state error. A fourth 
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smallest error. 


order model with two zeros had p= m 
Dr em re een 
the Although m 





1 0 0.000341 
the fourth order model is 2 0 0.000895 
2 i 0.000895 
slightly more accurate in terms 3 0 0.000687 
3 Il 0.000661 
of mean absolute error, the 3 2 0.000661 
4 0 00 
first order model performance is 4 1 0.00101 
4 2 0.000120 
almost  indistinguishable from | 4 3 0.000120 
| 5 0 0.000873 | 
that of the fourth order model. 
Table 4-2 -- System 
The transfer functions of these Identification of Depth 
Rate Data 
models for the AUV's depth rate 
were estimated as 
y 3 (s) e 
ici. ONIS (4-16) 
u (s) s+0.08809 
Planes 
and 
ρα. 0.1006s?«1.607540.4324 


Sn (4-17) 
U nns 9) 8° +6.5225°+8.2385°+3.131s5+0.2079 
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(3) The Speed Controller 
The input signal for the speed model was a 
square wave with a maximum magnitude of 480 RPM, a minimum 
magnitude of 260 RPM, and a frequency of 0.05 r/s. The AUV 
model was driven with this signal and the resultant input and 
output signals are shown in the Figures 4-lla and b 


respectively. 


Model N=1 M=0 





Figure 4-11 - Speed Data and Resultant Models 


The system identification routine GET MOD.M was 
again used to generate a set of linear models for the above 
input and output data sequences. The results of the system 


identification are shown in Table 4-3. 
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Since the first order model had 











D pem en 


0.00110 | 
0.00147 | 
0.00110 
0.00445 
oo 
0.00128 
0.00468 
eoo 
oo 


the smallest mean absolute state 









error of the models considered, 
no higher order models were used 
for comparison. The estimated 


transfer function of the first 


P» UOUCOUCO ho NO I 
NOR ONF OF © © 


order model of the AUV's surge 
Table 4-3 =- System 

state is Identification of Speed 
Data 


DEUS) 0.0007173 
CCP ades MCI c L (4-18) 
ons) s+0.1566 


A comparison of this model to the actual system are shown in 
Figure 4-llc. 
σ. Summary of Control 

The path follower outputs command signals for the 
control of the AUV's course rate, depth rate, and surge. Three 
first order direct adaptive control Hopfield networks were 
used to provide a suitable control signal to the actuators. 
Each of the three states is modeled as a first order system 
(N-1, M-0) and the estimated models of these systems may be 
used with the routine FIND HK.M to determine initial estimates 
of the control polynomial parameters output by the Hopfield 


network. 
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3. Limitations of the Control Scheme 

The piecewise linearity of the AUV is highly dependent 
upon its forward speed [Ref. 1: pp. 25-62]. At very low 
forward speeds (i.e. at less than 1 ft/s) the control surfaces 
have little effect on the motion of the AUV making the system 
appear uncontrollable and rendering the Hopfield network 
controller and path follower ineffective. Provisions must be 
made to prevent attempted convergence of the Hopfield network 
under these poor conditions. 

4. The AUV Control Simulation 

For the control simulation, a reference point moves 
along a prescribed path in a three dimensional space. The 
goal of the path following control is to generate three 
reference signals to keep the AUV as close to the reference 
point as possible. These three reference signals were passed 
to the Hopfield network controller in order to maintain the 
course rate, depth rate, and forward speed at the level of the 
reference signal filtered by the appropriate reference model 
l/p'(s). Thus the Hopfield network based direct adaptive 
control of the AUV requires three reference models to be 
denoted p'.(s) for course rate control, p',(s) for depth rate 
control, and p',(s) for the surge control. The determination 
of these reference models is clearly critical to system 


performance. 
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As in any real world application the available control 
force is limited. In the case of the AUV, the control force 
for course rate and depth rate control is limited by the 
physical geometry of the control surfaces. The control 
surface input is limited to about 23° or 0.4 radians of 
rotation. The shaft RPM input is limited to range between 
110 RPM and 750 RPM. The lower limit on shaft RPM prevents 
the vehicle from slowing to speeds where the control surfaces 
lose effect. These control force limits restrict the choices 
available for the reference models. If a reference model is 
too fast, the control surface is unable to meet the model and 
the system oscillates around the ordered state. The designer 
must ensure that the reference models are reasonable for the 
system to be controlled. Initially, the three models were 
chosen as Butterworth polynomials with a cut-off frequency of 
90-2 r/s. The three observer polynomials were chosen as 
Butterworth polynomials of frequency 0.8 r/s. 

The path-following parameters are also important to 
ensure accurate reference point tracking. If the path- 
follower attempts να drive the physical system beyond its 
capability to respond, the system cannot properly follow the 
path. However, if the path follower does not drive the system 
hard enough, the path following is slow to react to errors. 
The initial choice of parameters was: K,-0.5, K,-0.01, K,-0.2, 


and K,=0.5. 
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The AUV was started at coordinates Χξο, Y=0, and Z=0. 
The reference point was started at X,,,720, Y,,,-20, and Z,,,-20 
generating an initial position error of 28 ft and an initial 
depth error of 20 ft. The reference point course rate, depth 
rate, and forward speed were changed according to the schedule 


in Table 4-4: 


course rate depth rate forward speed 
(r/s) (ft/s) (ft/s) 





Table 4-4 - Reference Point Schedule 


The simulation was run and the resultant motion of the AUV in 
the XY plane is shown in Figure 4-12a. Figure 4-12b shows 
the motion of the AUV in the depth plane. Figure 4-12c shows 
the time history of the range from the vehicle to the 
reference point. These plots show that the AUV follows the 
reference point fairly well throughout the circuit. The AUV 
corrects well for the initial range error of 28 ft. The first 
two 90? turns are made at turn rates faster than the AUV model 
can match since the AUV's turn rate with full rudder 
deflection at 2 ft/s is π/25 r/s. The AUV cannot keep up with 


these tight turns and the AUV's distance from the reference 


52 


XY position 


—150 — 100 


Depth vs. t 


om, Amm 
c = 
ae? W 
€ Y 
d σι 
5 c 

O 
e [84 





Figure 4-12 - Initial AUV Path Following Simulation 


point increases. After two tight turns the AUV resolves its 
position error during the long straight leg of the path. The 
last 180? turn is at a turn rate slow enough for the AUV to 
follow and yet there is still significant cross range error, 
inferring that the cross range error coefficients are not 
properly set. The plot of the AUV's depth reveals that the 
depth control is effective with small overshoot and reasonable 
settling time. The plot of the AUV's range from the reference 
position reveals that once the initial error has been resolved 
the AUV remains within eight feet of the reference point with 


the error increasing during reference point maneuvers. 
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Although the output of the Hopfield network was 
initialized to the predetermined coefficients of the h(s) and 
k(s) polynomials and the gain g,, the linear models are not 
necessarily good representations of the AUV at varying speeds. 
Since the AUV is a nonlinear system, the Hopfield network 
output changes to adjust to new plant linearizations. Figure 


4-13 shows plots of the parameter vectors for each of the 


2 


Porometers of the course mode 
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Figure 4-13 - AUV Control Parameter Vector 


three controls versus time. The plot of the parameter vectors 
shows the dynamic nature of the control parameter vectors. 
The control vectors are continually adjusted to best match the 


defined reference models. 
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Figure 4-12 showed that the AUV did not satisfactorily 
follow a slow turn with the given path-following parameters. 
In order to improve the response the cross range error 
parameters were increased to K,-0.1 and K,20.63. "The path and 
initial conditions remain the same as the previous simulation. 
A plot of the system performance is shown in Figures 4-14a, b, 


and c. 


XY position 


5 


Ronge vs. time 


Depth (ft) 
Range (ft) 


100 
Time (s) 
Figure 4-14 - Improved AUV Path Following Simulation 





The AUV's path in this simulation is clearly superior 
to that of the previous run. The AUV has completely overcome 
the initial position error within 30 seconds and maintains a 


much smaller range error during the wide turn. 
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The next group of simulations are run with a different 
form of path description. The preceding path was described by 
vehicle speeds, course rates, and depth rates. Although this 
method describes a path that is fairly easy for the vehicle to 
follow, it is relatively difficult for the path planner to 
input the path. A more typical form of path description is to 
define a set of waypoints and the time of arrival at each 
waypoint. This is a far easier method for a path planner to 
output a path description. 

A set of waypoints were defined as shown in Table 4-5. 
The AUV simulation was run p — M Á—— 

Time X E Z 
with the same constants and 
0 20 20 20 


initializations as the 


» 75 
previous run. The resultant 105 
i 200 
path of the AUV in the XY 250 





plane is shown in Figure 4- Table 4-5 - Waypoints for AUV 
15a and it shows that the AUV "TN 

overshoots the waypoint and accumulates significant error at 
every turn. 

One method of reducing the overshoot is to reference 
the X and Y position error from a point that travels a fixed 
distance behind the reference point. This allows the AUV to 
'look ahead' at the reference point and anticipate maneuvers. 
Several different following-ranges were tried and it was found 


that following six feet behind the reference point produced 


the best path based on mean range error. The system was 
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Figure 4-15 - AUV Traversal of Waypoint Path 


simulated again with the waypoints from Table 4-5 and the 
resultant path in the XY plane is shown in Figure 4-16a. 

The AUV follows this path more closely because the AUV 
is able to begin turning priore to reaching the waypoints. 
However, if it is necessary for the AUV to pass through the 
waypoints this range-following modification should not be 


used. 
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Figure 4-16 - AUV Traversal of Waypoint Path, Following 
Distance Six Feet 
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V. THE HOPFIELD NETWORK AS AN ELECTRONIC CIRCUIT 

The major impetus for the use of a Hopfield network for 
direct adaptive control was the ability to implement the 
Hopfield network in analog hardware. This implementation was 
a straightforward translation of the Hopfield network based 
direct adaptive controller shown in Figure 4-1. The two 
ο αποηεα] components used were an operational amplifier (op 
amp) and a four-quadrant analog voltage multiplier. Since the 
controller was intended for use in a Very Large Scale 
Integrated (VLSI) circuit the op amps and multipliers were 
designed with complementary-symmetry metal-oxide semiconductor 


(CMOS) field-effect transistor technology (Ref 9:p. 773]. 


A. A SIMPLIFIED FIRST ORDER SYSTEM CONTROLLER 

Since all three AUV controls were modeled as first order 
systems this was the system order simulated. Before 
proceeding, we considered a simplified first order direct 
adaptive controller. 


Given the uncertain first order system 


y(t) = -a y(t)+b u(t) (5-1) 


where a and b are unknown constants and the reference model 


y(t) » -p' y(t)*v(t) (5-2) 
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and equating them yields 
-a y(t)+b u(t)=-p* y(t)+v(t). (5-3) 


The solution of u(t) from equation (5-3) is 
a 1 ; 
ms E a y(t)*v(t))- (5-4) 


When u(t) is determined by equation (5-4), then the output 
y(t) tracks the output of the reference model given by 
equation (5-2). Since a and b are unknown they must be 
estimated. 

The Hopfield network was used to estimate these parameters 
much as it was used to estimate the parameters for the higher 
order systems. Equation (5-1) was rearranged solving for u(t) 
and filtering both sides by an arbitrary first order stable 


monic polynomial qí(s) 


1 
NU ett es 


q(s) b q(s) b q(s) 











y(t). (5-5) 


It was seen that the coefficients a/b and 1/b present in 
equation (5-5) were the same as the unknown control 


coefficients in equation (5-4). Equation (5-5) is in the RLS 
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estimation form of equation (2-15) where 


y(t) 
y(t) 


1 
q(s) 


x(t)- u(t); $(t)- θ- (5-6) 











cilm ola 


Le 


Thus a two neuron Hopfield network may be used to estimate the 
parameters a/b and 1/b necessary for the controller. A 
diagram of the first order Hopfield network controller is 
shown in Figure 5-1. 

A simulation of this implementation was conducted using 
the simulation tool TUTSIM. The code for this simulation 
implementing the flow diagram of Figure 5-1 is included in 


Appendix B. The plant to be controlled was 








15 
y(t)=— u(t} (5-7) 
S+ 
and the reference model was 
1 
y(t)= v(t). (5-8) 
s+] 


The pole of the observer q(s) was -2 r/s, the pole of the 
filter for T and C was 100 r/s, and both outputs of the 
Hopfield network were initialized to 0.1. The reference input 
v(t) was a unit magnitude square wave of frequency 0.05 r/s. 
The plot of the input and output of the system as well as the 


Hopfield network output are shown in Figure 5-2. 
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Figure 5-1 - First Order Direct Adaptive Hopfield Controller 
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Figure 5-2 - Results of First Order Hopfield Net 


Figure 5-2a shows the input square wave v(t) and the 
system output y(t). The system output converges to the 
reference model output. Figure 5-2b shows the convergence of 
the parameters of the Hopfield network. The Hopfield network 
output converge to the vector [0.13333 0.66667]" which is the 


actual value of 80. 


B. ΤΗΕ FIRST ORDER SYSTEM IN ANALOG HARDWARE 
Figure 5-1 was converted to an analog circuit by replacing 
the integrators, summers, and gain blocks with the 


corresponding operational amplifier circuits [Ref. 14:pp. 35- 
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125]. The multiplier blocks were replaced by Analog Devices 
internally trimmed precision IC multipliers, model number 
AD534 [Ref. 15:pp. 6-27 to 6-35]. The actual Hopfield 
network portion of the circuit worked as expected, converging 
to the expected value of 0 for a set value of T and C. 
However, when the closed loop system was run, the output 
of the Hopfield network tended to saturate. Once the Hopfield 
network output was saturated, the entire system saturated 
until the system was reset. A remedy for this problem is to 
scale the reference signal to maintain lower voltage levels in 
the system. Unfortunately, this would also tend to reduce the 
eigenvalues of the Hopfield network, slowing convergence. A 
SPICE simulation of the Hopfield network controller was 


designed to more closely analyze this problem. 


C. THE SPICE SIMULATION 
The eventual goal of this work is to generate a single 
integrated circuit (IC) that holds the aforementioned 
circuitry. Since a CMOS design is best suited to analog VLSI 
circuits, all components were designed using CMOS technology. 

1. The CMOS Op Amp 
The CMOS op amp is a fairly common device. The 
example used in this work was chosen because of its simplicity 
as well as the availability of the SPICE parameters for the 
transistors [Ref 9:pp. 774-775]. General principles for the 


design of CMOS op amps are found in Reference 16. 
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2. The CMOS Four Quadrant Analog Voltage Multiplier 
The design of the multiplier is based on the square 
law characteristic of the current-voltage curve of the CMOS 
transistor in saturation [Ref. 17:pp. 531-532]. Figure 5-3 is 


a diagram of the CMOS multiplier. 





Figure 5-3 - CMOS Analog Voltage 
Multiplier 


The resistors R, through R, are identical and transform 
the input voltages V, and V, into the transistor input signals 
V,/2, V;/2, (V,*V;)/2 for input into transistor M,, M,, and M, 
respectively. Transistor M,'s gate is grounded to provide a 
zero voltage reference signal. 

The four CMOS transistors are p-channel devices that 


operate in saturation. The source currents of these 
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transistors are 





en 
I =K | —-v'-v, 
2 (5-9) 


and 


NN (5-10) 





where W and L are the length and width of the transistor gate, 
Hp is the mobility of holes, and C, is the capacitance per 


unit area of the silicon dioxide gate. The output voltage 


referenced to V,,, is 


V --ννΕ (5-11) 


where R is the resistance value of R, and R,. 

Thus the output of this device is a voltage difference 
proportional to the product of the two input voltages. A 
major problem with this implementation is that the voltage 
output requires a high gain differential amplifier on the 


output. Although this multiplier design is not completely 
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satisfactory, it was used in the SPICE simulation to gain 
insight into the difficulties of building an analog circuit 
direct adaptive Hopfield network controller. 
3. SPICE Simulation of the Hopfield Network 
The first step in the SPICE implementation was the 
simulation of the linear two element Hopfield network noted in 
Figure 5-1. The inputs to the system were the T matrix and 


the C vector and were set to 


-1 0.1 
, C = 








} | (5-12) 


The theoretical solution of the Hopfield network was 
determined by solving for the steady state output of the step 


response of a state space system where A=T and B=C. The 


steady state output was calculated as [Ref. 18:p. 688] 


1.0302 
0.3015 


i (5-13) 


INI C:- 








The SPICE simulation was run with @ initially set to [0.1 
0.1]. A plot of the Hopfield network output is shown in 


Figure 5-4. The output of the Hopfield network converges to 


[0.9968 0.2865]" which is within five percent of the 


theoretical values shown in equation (5-13) demonstrating that 
a Hopfield network is easily implemented with analog 


components. 
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Convergence of Hopfield Network Output 
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Figure 5-4 - SPICE Hopfield Net Output 


A SPICE circuit was designed to implement Figure 5-1 
and is included in Appendix C. The major components of the 
circuit were written as subcircuits to improve the clarity of 
the code. The SPICE simulation showed that the multipliers 
representing the T and C matrices saturated causing the 
Hopfield network output to saturate as seen in the analog 
circuit mentioned earlier. One remedy to this problem is to 
scale the reference signal so that the internal signals do not 
saturate the analog devices at the cost of slowed convergence 


rate. 
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D. REMARKS ON THE ANALOG CIRCUIT IMPLEMENTATION 

The analog circuit implementation of this controller is 
theoretically possible, but the actual implementation in 
analog hardware proved more difficult. Since the multipliers 
and op amps saturate at relatively low levels, the system 
input signals may need to be scaled to ensure that all 
internal signals remain within saturation limits of the 
hardware. While the scaling process is straightforward, it 
tends to slow the rate of convergence of the Hopfield network. 

There are other possible solutions to this problem that 
may not slow the convergence rate which need to be 
investigated before a reliable analog implementation of the 
Hopfield network based direct adaptive controller can be 


completed. 
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VI. SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 


A. SUMMARY 

The stability and convergence of a direct adaptive 
Hopfield network controller was shown for linear minimum phase 
systems. This result was extended to include nonlinear 
systems that could be modeled as piecewise linear minimum 
phase systems. Simulation studies of a linear system, an 
inverted pendulum, and the NPS AUV were included to examine 
the capabilities and limitations of the Hopfield network 
control scheme. Work on a suitable path following algorithm 
was included as a possible implementation of the direct 
adaptive Hopfield network control scheme. 

The design of an electronic circuit to act as a Hopfield 
network was investigated. Computer simulations of a 
functional model of the circuit revealed no significant 
defects in the theory. However, an actual hardware model and 
a SPICE simulation of the controller did uncover several 


severe problems in the physical implementation of the circuit. 


B. CONCLUSIONS 
The simulations of the direct adaptive Hopfield network 


controller revealed the following: 
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use 


In a digital simulation, the Hopfield network approach to 
direct adaptive control behaves similarly to the recursive 
least squares approach. 


The speed of convergence is highly dependent upon the 
magnitude and frequency content of the reference signal. 


The Hopfield network controller is a suitable controller 
for use with a complex multiple input multiple output 
nonlinear system. This controller also works well within 
the framework of a higher level controller such as the 
path following algorithm. 


The analog circuit implementation of the direct adaptive 
Hopfield network controller is feasible but is subject to 
the effects of the non-ideal analog components. 
RECOMMENDATIONS 


This thesis laid the foundation for further work in the 


of Hopfield networks for direct adaptive control. There 


remains a great deal of ground uncovered including: 


Improving the speed of convergence of the Hopfield 
network. 


The effect of disturbance and measurement noise on the 
convergence of the Hopfield network. 


Implementing the Hopfield network for control of non- 
minimum phase systems. 


Optimizing the AUV path follower parameters with respect 
to the Hopfield network controller reference models. 


Improving the analog circuit design of the direct adaptive 
Hopfield network controller to improve the circuit's 
resilience to non-ideal components. 


Generating an analog VLSI design for the Hopfield network. 
Writing code to provide for the automatic generation of a 
Hopfield network given the reference model, the observer 


polynomial, the system order, and the pole for the weight 
Matrix filter. 


na 


APPENDIX A. MATLAB SOFTWARE 


$$9999999999 9999999 99999999999 FIND HK.M $9999999999999 99999999 99999999959 
function [h,k,gp]-find hk(a,b,pstar,q) 
$ FIND HK.M - USAGE: [h,k,gp]-find hk(a,b,pstar,q) 


$ This function determines the direct adaptive control polynomials 
$ h(s) and k(s) and the input gain gp given the system denominator 
% and numerator polynomials a(s) and b(s) respectively, the 

% reference model polynomial pstar(s), and the observer polynomial 
$ q(s). 

% 

& R. Scott Starsman 11-25-91 

=rlz(b); % Remove leading zeros 
bpstar=conv(b,pstar); 
n=length(a)-1; & System Order 
m-length(b)-1; % Number of Zeros 


% set up the Sylvester Matrix 
Sa=[a';zeros(n-1,1)]; 
Sb=[zeros(n-m,1);b';zeros(n-1,1)]; 

for k=2:n 

Sas[Sa [zeros(k-1,1);a';zeros(n-k,1)]]; 

Sb=[sb [zeros(n-m-1-*k,1);b';zeros(n-k,1)]]; 
end 
S-[Sa Sb]; % The Sylvester Matrix 


f=conv(g, a-bpstar/b(1))'; 


$ Determine solution to Diophantine Equation 
hk=inv(S)*f(2:length(f)); 


$g Determine controller polynomials and gain 
hzhk(n*1:2*n); 

kzhk(1:n); 

gp-1/b(1); 
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$9929292999999292992292929999299929292999 SIGMOID.M $22292929929999999999999999999929929291*$ 
function [Y]ssigmoid(X,sigtype) 

@SIGMOID This function subjects the input vector X to the transfer 
characteristic designated by sigtype. The function is called 
by: Yssigmoid(X,sigtype). 


sigtype specifies the transfer characteristic: 
- Sigmoid 

2 - tanH 

3 - Linear 

4 - Saturation 


rm 


R. S. Starsman 5-1-91 
Copyright (c) R. S. Starsman, 1991 
All Rights Reserved 


90 90 de de ge de de de de ge ge oe 


[n,m]ssize(X); 
if (sigtype--1) 
Y=ones(n,m)./(ones(n,m)+exp(-X)); 
elseif (sigtype==2) 
Y=(ones(n,m)-exp(-2*X))./(ones(n,m)+exp(-2*X)); 
elseif (sigtype==3) 
Y=X; 
elseif (sigtype==4) 
Eshard lim(X,-1,1); 
end 
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$9$959995999999999959999999999999 HOPFIELD.M$929$9$9959999599999999959999999999999 
function [V1] = hopfield(v0,T,c,T£,sigtype,maxval, lambda) 

ΦΗΟΡΕΙΕΙΡ Iterates a Hopfield net for Tf seconds given the initial state 
of the Hopfield net vO, the weight matrix T, the bias vector C, 
the sigmoid type (sigtype), the scale factor, lambda (optional), 
and the neuron saturation level, maxval (optional). 


The matrix T must be negative definite. 


sigtype specifies the transfer characteristic: 
1 - Sigmoid 
2 - tanH 
3 - Linear 
4 - Hard limited saturation 


maxval is an optional parameter that specifies the upper and lower 
bound on bounded neural outputs (sigtype-1, 2, or 4). The 
default value is 1l. 


lambda is a scale function that multiplies the T and C matrices. 
The larger lambda is, the faster the convergence. The default 
value is 1. 


USAGE: 
V-hopfield(U,T,C,Tf,sigtype,maxval,lambda) 


dP dP dP dP dP dP dP 90 dP dP 90 dP dP dP 90 dP dP dP 90 90 dP oe 


& Set default values if necessary 
if nargin<7 
lambda=1; 
end 
if nargin«6 
maxval=1; 
end 


& Scale T and C by lambda 


T-lambda*T; 

C-lambda*C; 

if sigtype-- % Linear Neuron 
[Phi,Del]sc2d(T,C,TÍ); & Discretize net 
V1=Phi*v0+Del; $ Iterate one step 

else 

if sigtype--4 % Saturating Neuron 
[Phi,Del]sc2d(T,C,TfÍ); & Discretize net 
Vl-hard lim(Phi*VO-*Del,-maxval,maxval); $ Iterate and limit output 

else 


$ Sigmoidal or tanH Neurons 
$ Routine based upon a modified version of MATLAB function ODE45.M 


% The Fehlberg coefficients: 


alpha = [1/4 3/8 12/13 1 1/2]'; 

beta = [ [ 1 0 0 0 0 0]/4 
[ 3 9 0 0 0 01/32 
[ 1932 -7200 7296 0 0 0)/2197 
[ 8341 -32832 29440 -845 0 0]/4104 


[-6080 41040 -28352 9295 -5643 0]/20520 J’; 
gamma = [ [902880 0 3953664 3855735 -1371249 277020]/7618050 

[ -2090 ο 22528 21970 -15048 -27360]/752400 1; 
pow - 1/5; 
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trace 
tol z 


= 0; 
1.9-6; 


% Initialization 


τοξο; 


tfinal=Tf; 


y0=v0; 


t = t0; 


hmax 


(tfinal - t)/5; 


hmin (tfinal - t)/20000; 

h = (tfinal - t)/100; 

y 7 y0(:); 

f = y*zeros(1,6); 

tout = t; 

yout Y-.'; 

tau tol παν ος 'inf'), 1); 


% The main loop 


while (t < tfinal) & (h >= hmin) 


if t * h > tfinal, h = tfinal - t; end 


% Compute the slopes 
% Call to neuron function sigmoid substituted here for 


% nonlinear function 
f(:,1)2T*maxval*sigmoid(y/maxval,sigtype)-4C; 
for j = 1:5 


f(:,j*1)sT*maxval*sigmoid((y*h*f*beta(:,j))/maxval,sigtype)-*C; 
end 


% Estimate the error and the acceptable error 
delta = norm(h*f*gamma(:,2),'inf'); 
tau = tol*max(norm(y, 'inf'),1.0); 


% Update the solution only if the error is acceptable 
if delta <= tau 

t=t +h; 

y = y + h*f*xgamma(:,1); 
= [tout; t]; 
- [yout; y.']; 
end 


% Update the step size 
if delta ~= 0.0 

h = min(hmax, 0.8*h*(tau/delta) *pow) ; 
end 


end; 


if (t < tfinal) 


disp('SINGULARITY LIKELY.') 
€ 


Vl=maxval*sigmoid(yout(length(tout),:)/maxval,sigtype) ' 
end 
end 
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$9?92979927927927292999299592922792995229929 HOPINIT.M 2$?$99299999999999999999999929929999*9 


$ HOPINIT 

% This is the initialization script file for the direct 

% adaptive control Hopfield net problem files. 

% Variable set in this file include: 

% 

% Ts - The sampling time 

% Tf - The final time 

% ZOH - the number of time steps in the zero order hold 

% sigtype - The neuron transfer characteristic (see SIGMOID.M) 
% lambda - The Hopfield net weight matrix gain 

% alpha - The pole of the filter for the T and C matrices in r/s 
% maxval - The maximum value the neurons are allowed to attain. 
% This is used for the saturating neurons 

% a - System denominator discrete time polynomial 

% b - System numerator discrete time polynomial 

% v - Reference signal 

% 

% R. Scott Starsman 11-25-91 

Ts=.1; % Sampling time 

Tf-100; % Final time 

Τσο το το, 

its-length(t); 8 # of iterations 

ZOHz10; $ Length in Ts of ZOH 

sigtype-4; % Sigmoid type 

lambda=1; $ T and C matrix gain 

alpha-1; $ Filter pole for T and C matrices 


maxval=inf; 
rand('normal'); 


% Set up the test system (the system to be controlled is defined here) 


% The depth model of the AUV 


al=. 07; 
bl=.04; 
m3 
K=1; 
Zda=1; 


% State 


% Forward speed 
% Initial depth error 


Space model of the system 


A=[-al -bl 0;1 0 0;0 -v*b1 0]; 
ΒΞ[1;0;0]; 


ς-[ο 011; 

Dz0; 

x02[0;0;2d]; Initial conditions 
[bc,ac]sss2tf(A,B,C,D,1); Continuous time TF model 


[Phi,Delj]jsc2d(a,b,Ts); 
[b,a]sss2tf(Phi,Del,c,d,1); 


Discrete time SS model 
Discrete time TF model 


90 de ge ge 


$ Condition a and b 
a-fliplr(a(2:length(a))); 
b=fliplr(rlz(b)); 


% Set system order and number of zeros 


n=length (a); % System order 
mce=length(rlz(bc) )-1; % Number of continuous time zeros 
md=length(b)-1; % Number of discrete time zeros 


$ Set the number of controller parameters 
numparms=2*n+1; 
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% Initialize system 

y=Zd*ones(its,1); 

u=(zeros(2*n-1,1);0.1]; 

sigmay=0; & Set measurement noise strength 
noise-sigmay*rand(t'); 

T-zeros(numparms,numparms); 

C=zeros (numparms,1); 

clear theta 

theta(:,1)=.1*ones(numparms,1); 


& Determine the reference signal 
% 

$ unit step 
$v-ones(t); 
% 

% sin wave 
&v-sin(t); 

% 

% Zero 
$v=zeros(t); 
% 


5 Whit Noise 
$v=rand(t); 
% 


& Square wave 
v=sign(sin(.2*t)); 
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$9999 995999599959 99999999 9959999 HOPPROBAÁ.M $$9$999999959 9999959999999 999 9595999 
% HOPPROB4 .M 

This script file simulates the direct adaptive 

Hopfield net control of a system. The initialization 

routine HOPINIT must be run prior to running this file. 


90 90 de de de 


R. Scott Starsman 11-18-91 


rand('normal') 
$ Initialize copies of T and C for use in the ZOH 
T1l-T; Cl1-sC; 


tl=clock; & Set a timer 
pstar=butterw(n-mc,1); % Determine the reference model 
q-butterw(n,2); % Determine the observer 
pstarg=conv(pstar,q); 

[hl,kl,gl]-find hk(ac,bc,pstar,q); % Find the actual controller 


$ Determine th model's response to the input signal 
model-lsim(l,pstar,v(1:length(t))*pstar(length(pstar)),t); 


$ Filter for derivatives of y and u 
[Af,Bf,Cf,Df]-tf2ss(l,pstarq); 

Cfzeye(Af); 

Dfz-zzeros(Bf); 

[Phif,Delf]sc2d(Af,Bf,Ts); 

ybar=zeros(2*n-mc,1); % Initialize the filters 
ubar=zeros(2*n-mc,1); 


% Filter for Calculating u 

Aqs-[-q(2:n*1);eye(n-1) zeros(n-1,1)]; 

Aq-blokdiag(Aqs); 

Bqsz[1;zeros(n-1,1)]; 

Bq-blokdiag(Bqs); 

[Phiq,Delq]s2c2d(Aq,Bq,Ts); 

xq-zeros(2*n,1); $ Initialize the filter 


$ Filter for the T and C matrices 
pole=alpha; 
A=-pole; 

=pole; 
[PhiTC,DelTC]-c2d(A,B,Ts); 


% This loop is to initialize the filters and the system 
for k=n+1:2*n 
ybar=Phif*ybar+Delf*y(k-1); 
ubar=Phif*ubar+Delf*u(k-1); 
xgq=Phiq*xq+Delq*[y(k-1l); u(k-1)]; 
u(k)=theta(:,1)'*[xq;v(k) ]; 
y (k)=-a*y (k-n:k-1)+b*u(k-md-1:k-1); 
end 


% Simulate the Hopfield net direct adaptive controller 
for k=2*n+l:its 
y(k)z2-a*y(k-n:k-1)*b*u(k-md-1:k-1); & Iterate the system 


% Prepare phi(t) and s(t) 


ybar=Phif*ybar+Delf*y(k-1); % Update the filtered versions 
ubar=Phif*ubar+Delf*u(k-1); % of y(t) and u(t) and derivs 
phis[ybar(n-mc*1:2*n-mc);ubar(n-mc*1:2*n-mc);y(k)]; $ Form phi(t) 
sS-q*ubar(n-mc:2*n-mc ); & Form s(t) 


78 


$ Determine T and C and apply ZOH 

Tl-hard lim(-DelTC*phi*phi'*PhiTC*Tl,-maxval,maxval); $ Update T 
Cl-hard lim(DelTC*phi*s*PhiTC*Cl,-maxval,maxval); $ Update C 
if (k«20) | (rem(k,ZOH)==0) T=T1; C=Cl; end % Apply ZOH 


% Iterate the Hopfield net 
theta(:,k-2*n+1)=hopfield(theta(:,k-2*n),T,C,Ts, lambda,maxval,sigtype) ; 


% Limit the estimate of gp from falling below σ1/5 
if theta(numparms,k-2*n+1)>g1/5 theta(numparms,k-2*n+1)=g1/5; end 


% Filter y(t) and u(t) for calculating the control signal 
xg=Phigq*xq+Delgq*[y(k-1); u(k-1)]; 
u(k)=theta(:,k-2*n+1)'*[xq;v(k)*pstar(length(pstar) )]; 


end 


etime(clock,tl) % Stop the timer 


n9 


$9$929299999299999999299999929929992999 PEND.M $9$99$999999299999999999992999299929929 
$ PEND.M 


% This is the MATLAB program for the Hopfield net control of 
5 an inverted pendulum. 

% 

% R. Scott Starsman 11-13-91 

Ts=.02; $ Sampling time 

Tf£=100; % Finish time 


tz0:;Ts:TÍ; 


its-length(t); % Number of iterations 

ZOH=1; % Set the ZOH length 

ZOHstart=500; % Set the iteration # to start ZOH 
sigtype=4; $ Transfer characteristic type 
lambda=160000000000; $ Gain for T and C 

pole=1; & Pole of filter for T and C 
maxval=inf; 

rand(‘normal'); 

b=1; % Pendulum damping 

m=.1; % Pendulum mass 

151/ % Pendulum length 

g=9 .8; % gravity 

nz2; % Estimated system order 

mc=0; $ Estimated continuous system zeros 
numparms=2*n+1; % Number of parameters to estimate 


& System initial conditions 
y=.0l*ones(its,1); 

yd=zeros(y); 
u=[zeros(2*n-1,1);90.1]); 
sigmay=0; 

sigmau=0; 
noisessigmay*rand(t'); 
T-Zeros(numparms,numparms ); 
C-zeros(numparms,1); 
theta(:,1)-z.1*ones(numparms,1); 


Y 
y dot 


de ae 


& This is the reference signal - square wave 
v=.l*sign(sin(.5*t))+.0*rand(t); 


% Hopfield Problem for upside down pendulum 


tl=clock; % Set a timer 

modfreq-1; $ Set frequency of the reference model 
pstar-zbutterw(n-mc,modfreq); $ The reference model 
q-butterw(n,4*modfreq); % The observer 


pstarq-conv(pstar,q); 


$ Estimate the value of h(s), k(s), and gp 
[hl,k1,gl]-find hk([1 b/m/1^2 -g/1l],1/m/1^2,pstar,q); 


model=lsim(1,pstar,v(l:length(t)),t); % The reference model output 


& Filter for derivatives of y and u 
[Af,Bf,Cf,Df]-tf2ss(l,pstarq); 
Cf=pstarq(length(pstarq) )*eye(Af); 
Df=zeros (Bf); 
[Phif,Delf]2c2d(Af,Bf,Ts); 
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ybar=zeros(2*n-mc,1); 
ubar=zeros(2*n-mc,1); 


% Filter for Calculating u 
Aqs-[-qd(2:n*1);eye(n-1) zeros(n-1,1)]; 
Aq-blokdiag(Aqs); 
Bqs-[1;zeros(n-1,1)]; 
Bq-blokdiag(Bqs); 

Cq=q(length(q) )*eye(Aq); 
(Phig,Delg]=c2d(Aq,Bq,Ts); 
Xq-zeros(2*n,1); 


$ Filter for the T and C matrices 
A--pole; 

B-pole; 
[PhiTC,DelTC]sc2d(A,B,Ts); 


ἃ Initialize the system and filters 

for k=n+1:2*n 
% The pendulum 
yd(k)zyd(k-1)-b/m/1^2*xyd(k-1)*Ts4g/l*sin(y(k-1))*Ts; 
y(k)zy(k-1)*yd(k-1)*Ts; 


ybar=Phif*ybar+Delf*y(k-1) ; 
ubar=Phif*ubar+Delf*u(k-1); 
phi=[ybar(n-mc+1:2*n-mc) ;ubar(n-mc+1:2*n-mc) ;y(k-1) ]; 
s-q*ubar(n-mc:2*n-mc); 
T-hard lim(-DelTC*phi*phi'-4PhiTC*T,-maxval,maxval); 
C-hard lim(DelTC*phi*s*PhiTC*C,-maxval,maxval); 
xg-(Phig*xg*Delg*[y(k-1); u(k-1)]); 
u(k)-theta(:,1)'*[xq;v(k)]; 

end 


& Simulate the system 

for k=2*n+1l:its 
% The pendulum 
yd(k)zyd(k-1)-b/m/1^2*xyd(k-1)*Ts*g/l*sin(y(k-1))*Ts*u(k-1)/m/1^2*Ts; 
y (k)zy(k-1)*yd(k-1)*Ts; 


% Determine the phi vector and s(t) 
ybar=Phif*ybar+Delf*y(k-1); 
ubar=Phif*ubar+Delf*u(k-1); 

phi=[ybar(n-mc+1:2*n-mc) ;ubar(n-mc+1:2*n-mc) ;y(k-1) J; 
s-q*ubar(n-mc:2*n-mc); 


& Update T and C 
T-hard lim(-DelTC*phi*phi'-PhiTC*T,-maxval,maxval); 
C-hard lim(DelTC*phi*s-«PhiTC*C,-maxval,maxval); 


% Iterate the Hopfield net 
theta(:,k-2*n+1)=hopfield(theta(:,k-2*n),T,C,Ts,sigtype,maxval, lambda) ; 


Σ Prevent the estimate of gp from falling too low 
if theta(numparms,k-2*n+1)<g1/2 theta(numparms,k-2*n+1)=g1/2; end 


$& Filter y(t) and u(t) for the output calculations 
xq-(Phig*xq*Delq*[y(k-1); u(k-1)]); 


% Determine the system control signal 


u(k)-hard lim(theta(:,k-2*n*1)'*[xq;v(k)], -30,30); 
end 
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$9999 959979595 795999999 99$9999 GET MOD.M $$99929299999999999 955 95 9595992959 
$ GET MOD.M 

This file is used to determine a set of system models for 

the input/output data held in the vectors y and u 

respectively. These vectors are assumed to exist upon entry 
into this routine. The routine finds a set of continuous time 
transfer function models for varying plant order and numerator 
order. 


de de 90 de oe 90 90 oe 


R. Scott Starsman 11-25-91 


$ Clear these variables for later use 
nt-[]; dt-[]; results-[]; 


% Nested loop to determine the system order and number of zeros 
for n=1:5 & First to fifth order 
for m=0:n-1 & # of zeros less than number of poles 

% Find the model 
[num,den,theta]-find mod(y,u',n,m,Ts); 
y2=lsim(num,den,u,t); The model's response to the input 
ezy-y2; Generate an error vector 
nt=[nt;zeros(1,6-m) num]; Save the model numerator 
dt=[dt;zeros(1,6-n) den); Save the model denominator 


oe de 90 ge 


% Plot the actual data vs the model 

clg 

subplot(211) 

plot(t,y,t,y2,t,e) 

subplot(212) 

& Plot the convergence of the model parameters 
plot(t(1:length(theta)),theta"') 


$ Save the model order, # of zeros, and summed absolute error 
results-[results;n m sum(abs(e))]; 
end 
end 
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SESESTETETEETEEEEESESETETETEEEEEESE FIND ΜΟΡ.Μ ΕΡΕ ΝΕΤ ΕΕ ΕΕ ΕΕ τετ 
function [num,den,theta,P]-find mod(y,u,n,m,Ts) 

& FIND MOD.M - USAGE: [num,den,theta,P]-find mod(y,u,n,m,Ts) 

This routine returns a continuous time transfer function 

model of order n with m zeros for the input/output data y 

and u. The time interval between data points is given by Ts. 


y - y is a column vector of system output data 
u-u is a column vector of the system input 
n-n is the model system order 

m - m is the number of modeled zeros 

Ts - Ts is the time interval between data points 


num - num is the numerator polynomial of the modeled TF 

den - den is the denominator polynomial of the modeled TF 

theta - theta is the vector of parameters over time. This is 
useful for examining the convergence of the parameters 

P - P is the error covariance matrix. 


de de de dO dO de oP dP dP dO dO dO dO dO de dP 69 


R. Scott Starsman 11-15-91 
numparms=n+m+1; & Number of parameters to find 
theta=zeros(numparms,1); % Initialize theta 


& Estimate n-1 derivatives of y and store them all in yprime 
yprime-y; 
for k-2:n 
yprimes[[diff(yprime(:,1))/Ts;0] yprime]; 
end 
ydot=(diff(yprime(:,1))/Ts;0]; 


% Estimate m derivatives of u and store them in uprime 
uprime=u; 
for kz2:m*1; 
uprime-[[diff(uprime(:,1))/Ts;0] uprime]; 
end 


& Set up a matrix of y and its derivatives and u and its derivatives 
phi=[-yprime uprime]; 


% Initialize error covariance matrix 
P-le8*xeye(numparms,numparms); 


& Estimate system parameters using RLS 

for kzl:length(y)-numparms 
denzl*phi(k,:)*P*phi(k,:)*'; 
theta(:,k*1)-theta(:,k)*P*phi(k,:)'*(ydot(k)-phi(k,:)*theta(:,k))/den; 
P-P-P*phi(k,:)'*phi(k,:)*P/den; 

end 


% Return the numerator and denominator of the system 


den=[{1 theta(l:n,length(theta))‘]; 
num-theta(n-*1:numparms,length(theta))'; 
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$9299599959999999592595959952922992299 AUVPATH1.M 22$2$292292992992929222229292229292292922229 
$ AUVPATH1.M 

This file is the driver for the direct adaptive Hopfield 

net control of the AUV. This file uses the Kanayama 

path planning algorithm to generate state reference 

signals for the course rate, depth rate, and surge of the 

AUV. These state control signals are passed to the Hopfield 

net controller for actuation of the control surfaces. 


oe oe oe de oe oe 


$ Initialize the system 
dtz.25; 

TÍ-300; 

το η «τε 


Sample time 
Final time 


de oe 


its-length(t); $ Number of iterations 

ZOH=1; % ZOH time in numbers of time steps 
lambda-1; & T and C matrix gain 

sigtype-3; % Sigmoid type 

maxval=inf; % Neuron output limit 


rand( ‘normal’ ) 


Since three states need to be controlled, three Hopfield 
nets are required. Variables dealing with the course rate 
are appended with 'c', with the depth rate are appended 'd', 
and with the surge are appended 's' 


oe oe oe oe 


% Set the system order and the size of the Hopfield net 
nc-1; mcz0; numparmc=2*nc+l; 
ns-1; msz0; numparms-2*ns-*l; 
nd=1; md=0; numparmd-2*nd-*1; 


% Initialize T, C, the input, the output, and the auv position 
Tc=zeros(numparmc,numparmc); Cc=zeros(numparmc,1); gc=-5.6; 
Ts=zeros(numparms,numparms); Cs=zeros(numparms,1); gs=855.7; 
Td=zeros(numparmd,numparmd); Cd=zeros(numparmd,1); gd=3.973; 
yc=0*ones(t); uc=zeros(yc); 

ys=2*ones(t); us=400*ones(t); 

yd=0*ones(t); ud-zeros(yd); 

d0=0; $ Initial depth 
auvx=zeros(t); auvy=zeros(t); auvd=d0*ones(t); 

$ Initial AUV state 
x0-[ys(1);0;yd(1);0;0;yc(1);0;0;d0;0;0;0]; 


tl=clock; $ Start a timer 


& The first order system models for the three subsystems 
numc=-0.167;denc=[1 0.5]; 

nums=0.00065;dens=[{1 0.128]; 

numd=0.183;dend=[1 0.088]; 

% The system reference models and observers 
pstarc=butterw(nc-mc, .5); qc=butterw(nc,1); pstarqc=conv(pstarc,qc); 
pstars=butterw(ns-ms,.2); qs=butterw(ns,.8); pstarqs=conv(pstars,qs); 
pstard=butterw(nd-md, .5); qd=butterw(nd,1); pstarqd=conv(pstard,qd); 
% Estimate the control parameters from the system models 
[hc,kc,gc])-find hk(denc,numc,pstarc,qc);thetac-[hc;kc;gc]); 
[hs,ks,gs]-find hk(dens,nums,pstars,qs);thetas-[hs;ks;gs]; 
[hd,kd,gd]-find hk(dend,numd,pstard,qd);thetad-[hd;kd;gd]; 


$ Parameters and IC's for path follower 
% Kanayama path follower 

Kx=.1; 

Ky=.1; 


84 


Ktheta-sqrt(4*Ky); $ Critically damped system in CRE 
Kd=.5; 

RO=0; % Following range in ft 

vref=2; $ Initial reference speed 

wref=0; $ Initial reference course rate 
targddot=0; 8 Initial reference depth rate 


$ Initial reference position in X, Y, Z 
targxyd-[20 20 20 20 20; 
20 20 20 20 20; 
20 20 20 20 20); 
thetaref=0; $ Initial reference heading 
vcewref*ones(yc); vs-vref*ones(ys); vd-targddot*ones(yd); 


& Filter for derivatives of y and u 
[Afc,Bfc,Cfc,Dfc]-tf2ss(1l,pstarqc); 
[Phifc,Delfc]sc2d(Afc,Bfc,dt); 
[(Afs,Bfs,Cfs,Dfs]-tf2ss(l,pstarqs); 
[Phifs,Delfs]-c2d(Afs,Bfs,dt); 
(Afd,Bfd,cfd,Dfd]stf2ss(l,pstarqd); 
[Phifd,Delfd]sc2d(Afd,Bfd,dt); 
ybarc=zeros(2*nc-mc,1); ubarc=zeros(2*nc-mc,1); 
ybars-zeros(2*ns-ms,1); ubars-zeros(2*ns-ms,1); 
ybard=zeros(2*nd-md,1); ubard=zeros(2*nd-md,1); 


%* Filter for Calculating u 
Aqs-[-qc(2:nc*1);eye(nc-1) zeros(nc-1,1)]; 
Aqc=blokdiag(Aqs); 

Bqs-[1;zeros(nc-1,1)]; 

Bqc=blokdiag(Bqs); 

[Phiqc,Delqe ]=c2d(Aqc,Bqc,dt); 
Aqs-[-qs(2:ns*1);eye(ns-1) zeros(ns-1,1)]; 
Aqs=blokdiag(Aqs); 

Bqs-[1;zeros(ns-1,1)]; 

Bqs-blokdiag(Bqs); 
[Phiqs,Delqs]=c2d(Aqs,Bqs,dt); 
Aqs-[-qd(2:nd*1);eye(nd-1) zeros(nd-1,1)]; 
Aqd=blokdiag(Aqs); 

Bqs-[1;zeros(nd-1,1)]; 

Bqdzblokdiag(Bqs); 
[Phiqd,Delqd]2c2d(Aqd,Bqd,dt); 
xgc=zeros(2*nc,1); 

xqs-zeros(2*ns,1); 

xqd=zeros(2*nd,1); 


8 Filter for the T and C matrices 
polez1; 

A--pole; 

B=pole; 

[Phitc, DelTC]=c2d(A,B,dt); 


% Determine necessary length of initialization 
nzmax([nd;nc;ns]); 


$ Initialize the filters and the system 

for k=n+1l:2*n 
ybarc=Phifc*ybarc+Delfc*yc(k-1); 
ubarc=Phifc*ubarc+Delfc*uc (k-1); 
xqc=Phigqe*xqe+Delqe*[yc(k-1); uc(k-1) ] 
uc(k)-hard lim(thetac(:,1)'*[xqc;vc(k) 


— ]);7*4,.4); 
ybars=Phifs*ybars+Delfs*ys(k-1); i 
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ubars-Phifs*ubars*Delfs*us(k-1); 
xqs=Phiqs*xqs+Delqs*[ys(k-1); us(k-1)]; 
us(k)shard lim(thetas(:,1)'*[xqs;vs(Xk)],0,750); 
ybard=Phifd*ybard+Delfd*yd(k-1); 
ubard=Phifd*ubard+Delfd*ud(k-1); 
xqd=Phiqd*xqd+Delqd*[yd(k-1); ud(k-1)]; 
ud(X)shard lim(thetad(:,1)'*[xqd;vd(k)],-.4,.4); 
inputss([uc(k); -uc(k); ud(k); -ud(k); us(Xk)]; 
x0=auv2(x0,inputs,dt); 

yc(k)2x0(6); ys(k)2x0(1); yd(k)2(x0(9)-d0)/dt; 
d0=x0(9) 

auvx(k)=x0(7); auvy(k)=x0(8); auvd(k)=x0(9); 
thetaref=thetaref+wref*xdt; 


targxyd(:,k+1l)=targxyd(:,k)+[cos(thetaref)*vref;sin(thetaref)*vref;targd 
dot]*dt; 
end 


$ Simulate the AUV 
for k=2*n+l:its 
x0=auv2(x0,inputs,dt); $ Iterate the AUV one step 
& Pick out the course rate, depth rate, and surge 
yc(k)2x0(6); ys(k)2x0(1); yd(k)2(x0(9)-d0)/dt; 
d02x0(9); $ Keep track of the old depth 
$ Update the AUV's position 
auvx(k)=x0(7); auvy(k)=x0(8); auvd(k)=x0(9); 


% Path follower definitions 

if t(k)==70 vref=2; targxyd(3,k)=25; thetaref=pi/2; end 
if t(k)==95 vref=2; thetaref=pi; end 

if t(k)==105 vref=3; targxyd(3,k)=20; end 

if t(k)==110 vref=2; end 

if t(k)==200 vref=3; thetaref=-pi/2; end 

if t(k)==250 vref=2; thetaref=0; end 


%* Update the path follower 
$ Range from AUV to reference point 
R(k)ssqrt((targxyd(l,k)-auvx(k))^24(targxyd(2,k)-auvy(k))^2); 


% Determine the error posture 

temp-[cos(x0(12)) sin(x0(12));-sin(x0(12)) cos(x0(12))]; 
xyfollowstargxyd(1:2,k)-RO*[cos(thetaref);sin(thetaref)]; 
e-temp*(xyfollow-[auvx(k);auvy(Xk)]); 
thetae-thetaref-x0(12); 


$ Determine the command signals 
vc(k)swref*vref*(Ky*xe(2)4Ktheta*sin(thetae)) 
vs(k)=hard lim(vref*cos(thetae)+Kx*e(1),0,5) 
vd(k)=targddot+Kd* (targxyd(3,k)-x0(9)); 


o 
a 
9 
’ 


$ Update the reference points posture 
thetaref=thetaref+wrefxdt; 
deltarg=[cos(thetaref)*vref;sin(thetaref)*vref;targddot]*dt; 
targxyd(:,k+1)=targxyd(:,k)+deltarg; 


% Course Rate controller 

% Determine phi and s 

ybarc=Phifc*ybarc+Delfcxyc(k-1); 
ubarc=Phifc*ubarc+Delfc*uc(k-1); 
phis[ybarc(nc-mc*1:2*nc-mc);ubarc(nc-mc*1:2*nc-mc);yc(k)]; 
szqc*ubarc(nc-mc:2*nc-mc); 
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$ Determine T and C and iterate the Hopfield net 

Tc-hard lim(-DelTC*phi*phi'-*PhiTC*Tc,-maxval,maxval); 

Cc-hard lim(DelTC*phi*s«*PhiTC*Cc,-maxval,maxval); 

thetac(:,k-2*ntl)=... 
hopfield(thetac(:,k-2*n),Tc,Cc,dt,sigtype,maxval, lambda); 

if thetac(numparmc, k-2*n+1)>gc/5 thetac(numparmc,k-2*n+l)=gc/5; end 


% Determine the system control signal for the course rate 
xqc-Phiqc*xqc4*Delqc*[yc(k-1); uc(k-1)]; 
uc(k)sthetac(:,k-2*n«l)'*[xqc;vc(k)*pstarc(length(pstarc))]; 
uc(k)-hard lim(uc(k),-.4,.4); 


& Speed Controller 

% Determine phi and s 

ybars=Phifs*ybars+Delfs*ys(k-1); 
ubars=Phifs*ubars+Delfs*us(k-1); 

phi={ybars (ns-ms+1:2*ns-ms) ;ubars(ns-ms+1:2*ns-ms) ;ys(k) J; 
s=qs*ubars(ns-ms:2*ns-ms) ; 


% Determine T and C and iterate the Hopfield net 

Ts-hard lim(-DelTC*phi*phi'-*PhiTC*Ts,-maxval,maxval); 

Cs-hard lim(DelTC*phi*s«PhiTC*Cs,-maxval,maxval); 

thetas(:,k-2*nt+l)=... 
hopfield(thetas(:,k-2*n),Ts,Cs,dt,sigtype,maxval, lambda); 

if thetas (numparms,k-2*n+1l)<gs/5 thetas(numparms,k-2*n+1l)=gs/5; end 


% Determine the control signal for the surge 
xqs-Phiqs*xqs*Delqs*[ys(k-1); us(k-1)]; 
us(k)sthetas(:,k-2*n*1)'*[xqs;vs(k)*pstars(length(pstars))]; 
us(k)-hard lim(us(k),110,750); 


& Depth Controller 

& Determine phi and s 

ybard=Phifd*ybard+Delfd*yd(k-1); 
ubard=Phifd*ubard+Delfd*ud(k-1); 
phi={ybard(nd-md+1:2*nd-md) ;ubard(nd-md+1:2*nd-md) ;yd(k) ]; 
s=qd*ubard (nd-md: 2*nd-md) ; 


% Determine T and Cc and iterate the Hopfield net 

Td=hard lim(-DelTC*phi*phi'+PhiTc*Td, -maxval,maxval); 

Cd=hard_ lim(DelTc*phi*s+PhiTc*Ccd, -maxval,maxval) ; 

thetad(:,k-2*n+l)=... 
hopfield(thetad(:,k-2*n),Td,Cd,dt,sigtype,maxval, lambda) ; 

if thetad(numparmd,k-2*n+1)<gd/5 thetad(numparmd,k-2*n+1)=gd/5; end 


% Determine the control signal for the depth rate 
xqd=Phiqd*xqd+Delqd*{yd(k-1); ud(k-1)]; 
ud(k)=thetad(:,k-2*n+1)'*[{xqd;vd(k)*pstard(length(pstard) ) J; 
ud(k)=hard_lim(ud(k),-.4,.4); 


% Form the input vector for the AUV model 
inputs-[uc(k); -uc(k); ud(k); -ud(k); us(k)]; 
end 
etime(clock,t1l) & Stop the timer 
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APPENDIX B. TUTSIM CODE 
PROFESSIONAL VERSION OF TUTSIM 
Model File: hopfield 


Date: 11/ 23 / 1991 
Time: 22: 0 


Timing: 0.0100000 , DELTA ; ,100.0000,  *' RANGE 
PlotBlocks and Scales : 
Format : 
BlockNo , plot-MINimum, Plot-MAXimum; Comment Horz: 0, 

0,0000 , 100.0000 ; Time 
Yl: 26 , -1,5000 , 1.5000 ; y 
Y2: 27 , -1.5000 , 1.5000 ; v 
Y3: 20 , -1,5000 , 1.5000 ; thetal 
Υ 4: 21 , -1.5000 , 1.5000 ; theta2 
2.0000 1 GAI 2 
0.0000 2 INT 3 ; y HAT 

3 SUM -1 30 ; y HAT dot 

4 MUL 3 3 

5 MUL 2 3 

6 MUL 3:25 

7 MUL 2 2 

8 MUL 2 25 
1.0000 9 FIO -4 ΤΙΣ 
0.0100000 
-0.1000000 
1.0000 10 FIO -5 .τώος T21 
0.0100000 
-0 1000000 
1.0000 11 FIO  -7 POT? 
0.0100000 
-0.1000000 
1.0000 12 FIO 8 Ge 
0.0100000 
0.1000000 
1.0000 13 FIO 6 pel 
0.0100000 
0.1000000 


17 MUL 21 11 
18 SUM 13 14 16 
19 SUM 12 15 17 


0.1000000 20 INT 18 ; thetal 
0.1000000 21 INT 19 ; theta2 
22 MUL 20 29 
23 MUL 21 26 

24 SUM 22 23 ; u 
1.0000 25 FIO 24 ; u HAT 
0.5000000 
0.0000 
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1.5000 
0.2000000 
0.0000 


1.0000 


0.0500000 
1.0000 


FIO 


SGN 
GAI 
SUM 
GAI 
FRQ 


28 


2l 


-26 
26 


27 


=e 


we 
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APPENDIX C. SPICE SOFTWARE 


FIRST ORDER HOPFIELD NET CONTROLLER 


* IMPORTANT NODES: 

* l1 -> y 

* 2 -» yHAT 

* 3 -» yHATDOT 

κι ο 10 XN TPITDTSTI2- | 
κο αν ο. τι του. 
x! 120 το ο, 

* L-I3 ορ δρ 

x 20 -> ΤΗΕΤΑΙ 

* 2] -» THETA2 

* 24 -> u 

* 25 -» uHAT 

* 27 -> v 


X1 24 101 102 1 SYSTEM 

101 102 2 3 YFILTER 

3 101 102 4 MULT 

3 101 102 5 MULT 

2 101 102 6 MULT 

25 101 102 7 MULT 

25 101 102 8 MULT 

101 102 9 TFILTER 

101 102 10 TFILTER 

X10 6 101 102 11 TFILTER 
X11 7 101 102 12 CFILTER 
X12 8 101 102 13 CFILTER 

X13 9 20 101 102 14 MULT 

X14 10 20 101 102 15 MULT 
X15 10 21 101 102 16 MULT 
X16 11 21 101 102 17 MULT 
X17 12 14 16 101 102 18 SUMMER3 
X18 13 15 17 101 102 19 SUMMER3 
X19 18 101 102 20 INTEG 

X20 19 101 102 21 INTEG 

x21 20 26 101 102 22 MULT 
x22 1 21 101 102 23 MULT 

X23 22 23 101 102 24 SUMMER2 
X24 28 101 102 24 INVERTER 
x25 24 101 102 25 UFILTER 
x26 27 1 101 102 26 DIFF 

VV 27 0 PULSE (-5 5 .1 0 O 4 8) 
VDD 101 0 Dc 12V 

VSS 102 0 DC -12V 

.TRAN 100MS 20S 

.PLOT TRAN V(1) V(27) 


A 
σι 
Ui i IO QN) ND) Ww ee 
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JSUBCKT SYSTEM 3 1 2 4 

* u Vdd Vss y 

* FIRST ORDER SYSTEM --» y/u-G/(Ts-*1) 
x G=(R1+R2)/R1; T-R3*Cl1 

Rl 6 0 100K 

R2 4 6 50K 

R3 3 5 200K 

c1 5 0 1U 

X15 6 12 4 MOPAMP 

.ENDS SYSTEM 


.SUBCKT CFILTER 3 1 2 4 

* Cin Vdd Vss cout 

* FILTER FOR C VECTOR --> Cout/Cin=G/(Ts+1) 
x G=1; T=R3*Cl 

Rl 4 0 100K 

R3 3 5 100K 

er 5 0 lu 


X15 4 12 4 MOPAMP 
.ENDS CFILTER 


.SUBCKT TFILTER 3 1 2 4 

* Tin Vdd Vss Tout 

x FILTER FOR T MATRIX --> Tout/Tin=-G/(Ts+1) 
x G=l; T=R1*C1; R1=R2=R3; R4=2*Rl 


Rl] 3 7 100K 

R2 6 7 100K 

R3 4 6 200K 

R4 5 0 200K 

er 7 0 1U 

ο. 4 6 .5U 

X15 6 12 4 MOPAMP 

.ENDS TFILTER 

.SUBCKT YFILTER 11 1 2 8 3 

* y Vdd Vss yHAT yHATDOT 
* FILTER TO DERIVE yHAT AND  yHATDOT  --»  yHAT/y-1/(Ts-*1); 


yHATDOT/y=s/ (Ts+1) 

* T=R2/R1=R4/R3 

Rl 11 12 10K 

R2 12 0 20K 

R3 9 8 10K 

R4 9 3 20K 

X1 129 12 3 MOPAMP 
X2 3 12 5 INTEG 

X3 5 12 8 INVERTER 
.ENDS YFILTER 


.SUBCKT UFILTER 3 1 2 4 

* Uin Vdd Vss Uout 

x FILTER FOR C VECTOR --> Uout/Uin=G/(Ts+1) 
x 6-51; T=R3*C1 

Rl 4 0 500K 

R3 3 5 500K 

C15 0 lU 

X15 4 12 4 MOPAMP 

.ENDS UFILTER 
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.SUBCKT INVERTER 3 1 2 4 

* vin Vdd Vss Vout 
* INVERTER --> Vout=-G*Vin 

* G=R2/R1; R3=R1!'R2 

Rl 3 6 100K 

R2 4 6 100K 

R3 5 0 50K 

X15 6 12 4 MOPAMP 

.ENDS INVERTER 


.SUBCKT DIFF 3 4 1 2 5 

* X Y Vdd Vss xX-Y 
* DIFFERENCE CIRCUIT 

Rl 3 6 100K 

R2 4 7 100K 

R3 6 0 100K 

R4 5 7 100K 

X16 712 5 MOPAMP 


.ENDS DIFF 
.SUBCKT SUMMER2 3 4 1 2 5 
* X Y Vdd Vss  -(X*Y) 


* 2 INPUT SUMMER CIRCUIT 
R1 3 7 100K 

R2 4 7 100K 

R3 5 7 100K 

R4 6 0 33K 

X1 6 7 1 2 5 MOPAMP 
.ENDS SUMMER2 


.SUBCKT SUMMER3 3 4 5 1 2 
* X Y Z Vdd Vss 
* 3 INPUT SUMMER CIRCUIT 

R1 3 8 100K 

R2 4 8 100K 

R3 5 8 100K 

R4 6 8 100K 

R5 7 0 25K 

X17 8 12 6 MOPAMP 

ENDS SUMMER3 

.SUBCKT INTEG 3 1 2 4 

* Vin Vdd Vss Vout 


* INTEGRATOR --> Vout/Vin=G/s 
*  G-1/(R1*C1); R2-Rl 

R13 5 IMEG 

R2 6 0 ΙΜΕς 

σι 4 5 IU 

X16 51 2 4 MOPAMP 

.ENDS INTEG 


6 
-(X*Y*Z) 


*ANALOG VOLTAGE MULTIPLIER FROM HONG & MELCHIOR (ELEC LTTRS 6 JUN 85) 


.SUBCKT MULT 3 4 1 2 12 

* X Y Vdd Vss Vout 
R1 3 5 5K 

R2 05 SK 

R3 4 6 5K 

R4 0 6 SK 

RS 4 7 5K 

R6 3 7 5K 

M1 15 8 1 CMOSP L=32U W=16U 
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M2 16 8 1 CMOSP L=32U W=16U 
M3 179 1 CMOSP L=32U W=16U 
M4 10 9 1 CMOSP L=32U W=16U 
X19 8 1 2 10 MOPAMP 


R7 11 9 10K 

R8 10 8 10K 

Εν. 5 0.10 11 297 
ROUT 12 0 1M 
V2MINUS 11 0 Dc -10 
.ENDS MULT 


.SUBCKT COPAMP3 3 4 1 2 5 
* V+ V- Vdd vss Vout 
*CMOS OPAMP FROM MICROELECTRONIC CIRCUITS (SEDRA AND SMITH) 


M1 9 4 6 1 CMOSP L=8U W=120U 

M2 8 3 6 1 CMOSP L=8U W=120U 

M3 9 9 2 2 CMOSN L=10U W=50U 

M4 8 9 2 2 CMOSN L=10U W=50U 

M5 6 7 1 1 CMOSP L=10U W=150U 
M6 5 8 2 2 CMOSN L=10U W=100U 
M7 5 7 1 1 CMOSP L=10U W=150U 
M8 7 7 1 1 CMOSP L=10U W=150U 
C1 8 10 10PF 


R4 10 5 10K 
M9 7 7 2 2 CMOSN L=250U W=5U 
.ENDS COPAMP3 


.SUBCKT MOPAMP 1 2 98 99 3 

* V+ V- Vdd Vss Vout 

RIN 1 2 6MEG 

ROUT 4 3 75 

El 0 41 2 200K 

* Rl AND R2 ARE USED TO MAKE THE OPAMP IDEAL MODEL PIN COMPATIBLE 
* WITH THE CMOS OPAMP 

R1 98 O 10M 

R2 99 0 10M 

.,ENDS MOPAMP 


.MODEL CMOSN NMOS LEVEL=2.00000 LD=0.6U TOX=8.5E-8 

+NSUB=1E+16 VTO=1 JS=1E-6 U0=750.000 UEXP=.14 UCRIT=5E4 UTRA=0 PB=.7 
+VMAX=5E4 XJ=1U CGBO=2E-10 

+RSH=15 CGSO=4E-10 CGDO=4E-10 CJ=4E-04 MJ=2 CJSW=8E-10 MJSW=2 

~-MODEL CMOSP PMOS LEVEL=2.00000 LD=0.6U TOX=l1E-7 NSUB=2E+15 VTO=-1 JS=1E-6 
+U0=100.000 UEXP=.03 UCRIT=1E4 UTRA=0 PB=.7 VMAX=3E4 XJ=.9U CGBO=2E-10 
+RSH=75 CGSO=4E-10 CGDO=4E-10 CJ=1.8E-04 MJ=2 CJSW=6E-10 MJSW=2 

. END 


93 


Τι 


10. 


11. 


172. 


13. 


LIST OF REFERENCES 


Schwartz, M. A., Kalman Filtering for Adaptive Depth, 
Steering, and Roll Control of an Autonomous Underwater 
Vehicle (AUV), Master's Thesis, Naval Postgraduate 
School, Monterey, CA, March 1991. 


Åström, K. and Wittenmark, B., Computer Controlled 
Systems: Theory and Design, Prentice-Hall, 1990. 


Kailath, T., Linear Systems, Prentice-Hall, 1989. 


Cristi, R., Notes for EC4360 (System Identification), 
Naval Postgraduate School, 1991 (unpublished). 


Söderström, T. and Stoica, P., System Identification, 
Prentice-Hall, 1989. 


NeuralWare Inc., Neural Computing, 1991. 


Kosko, B., Neural Networks and Fuzzy Systems, 
Prentice-Hall, 1992. 


Hecht-Nielsen, R., Neurocomputing, Addison-Wesley 
Publishing Co., 1990. 


Sedra, A. and Smith, K., Microelectronic Circuits, 
Holt, Reinhart, and Winston, 1987. 


The MathWorks Inc., MATLAB Programmer's Manual, 1986. 


Warner, D., Experimental Verification of a Computer 
Model and Enhanced Position Estimator for the NPS AUV 
II, Master's Thesis, Naval Postgraduate School, 
Monterey, CA, December, 1991. 


Miller, C., An Application of Extended Kalman 
Filtering to a Model-Based Short-Range Navigator for an 
AUV, Master's Thesis, Naval Postgraduate School, 
Monterey, CA, December, 1991. 


Kanayama, Y., and others, "A Stable Tracking Control 
Method for an Autonomous Mobile Robot", paper presented 
at the IEEE International Conference on Robotics and 
Automation, Cincinnati, Ohio, 13-18 May, 1990. 


94 


14. 


IN. 


16. 


17. 


18. 


Horn, D., How to Design Op Amp Circuits with Projects 
and Experiments, TAB Books Inc, 1984. 


Analog Devices, Analog Signal Processing Components, 
Vol I, 1989. 


Gregorian, R. and Temes, G. C., Analog MOS Integrated 
Circuits of Signal Processing, John Wiley and Sons, 
1986. 


Hong, Z. and Melchior, H., "Analogue Four Quadrant 
CMOS Multiplier with Resistors", Electronics Letters, v. 
21, pp. 531-532, June 6, 1985. 


Ogata, K., Modern Control Engineering, Prentice-Hall, 
1970. 


95 


INITIAL DISTRIBUTION LIST 


No. of Copies 


Defense Technical Information Center 
Cameron Station 
Alexandria, Virginia, 22304-6145 


Library, Code 52 
Naval Postgraduate School 
Monterey, California, 93943-5002 


Chairman, Code EC 

Department of Electrical and Computer Engineering 
Naval Postgraduate School 

Monterey, California, 93943 


Dr. A. J. Healey, Code ME 

AUV Project 

Department of Mechanical Engineering 
Naval Postgraduate School 

Monterey, California, 93943 


Dr. Roberto Cristi, Code EC/Cx 

Department of Electrical and Computer Engineering 
Naval Postgraduate School 

Monterey, California, 93943 


Dr. Murali Tummala, Code EC/Tu 

Department of Electrical and Computer Engineering 
Naval Postgraduate School 

Monterey, California, 93943 


Dr. Yutaka Kanayama, Code CS/Ka 
Department of Computer Science 
Naval Postgraduate School 
Monterey, California, 93943 


Mr. Robert Wilson 

Head, Systems Engineering Branch 

David Taylor Research Center 

Carderock, Bethesda, Maryland, 20084-5000 


Mr. Dan Steiger, Marine Systems Group 


Naval Research Laboratory 
Washington, D. C., 20032 


96 


2 


10. 


11. 


12. 


Mr. Kirk Dye 
Naval Coastal Systems Center 
Panama City, Florida, 32407-5000 


Technical Library 
Naval Surface Warfare Center 
Silver Spring, Maryland, 20901 


RADM Evans, Code SEA-92 


Naval Sea Systems Command 
Washington, D. C., 20362 


97 























Thesis 
567775 
ο.ἶ 


Starsman 


A Hopfield network 
approach to direct 
adaptive control of 
nonlinear systems. 








































































































































































































































































































































































































































































































Fam P se 





^o» Pa 
heel i 





LI LE -. ` Ld - 
are -- E ΓΙ η TENES " x 
LI LI - ^ am " - - P LI - * - 
m A " E PED E z E οσο ο 2 - » - - . 
2 " z E "an ο a E . Py 2 "S 
E mE DI X - TE a oes E - 2 ' . n "CES M "E 
ww E = " 2 w- - -* "UE eT E " Ps "P Ἢ πο » n 
P P P MM 2 - w^ MEL η g E Pr M η n « Ξ 
ο P -- n N t E B - "ES E LE . Ἢ - LI 
τ E E - - m E E =- + E ο η E —— » x e ee AD = 
Em Pan REA E E ieri. 2 H E s- “ "X κ "EU acs " 
3 M E ΠΤ E ο E E "E a ar " "s " " E E n ao ` * K E " 
. -- I ^ - - - P a . η E . H p . A « E 5 " "a * ee m 
E B - n . r D 2 " E a P E H P 5 3 Ν £ » 
- L] * - P « d . - μα . -^ L] ELI - - . 
EL. a D a H Ὁ " " m z^ n z P E 
M Ἢ; z g . .- ΕΙ NER- " e - PE 
E ES 
2 € " E - - Ἢ 2 " 
i E hi ni E Ld . . * Ες . 
r PE E ry . = . ^ «-» Fo o» 
MEM E " oases es . - e =- >% " = T = n 
>. E op * " - LET n E - " E = A τ 
A E η E PR - + "m - P MAE 
A x = A " " n è η "m ^ . P . .- "m "E - - 
" E E ee r H B B " x Pes κ ie ' ET 
E E d se PL os " κ r S 4 a ' 
bs 2 n i E = e * e να E - E = "TED - αγ A E rite 
- " E « . a PI -- " ιο A 2 P E ᾿ ; 
- . LI * E hd » bd LI - - - Li - ien 
L " P -.» 2 E - " m r r x κ E: br = κ 
a a . η E E η " -” n E » 
-» - LJ Ld ° Ld *c* - a Γη LI E LI η - --” 
E καὶ E e me = : D “5 = ns "a La ^ .. . Caj ΓΙ Ld ον " E 
WT E η E E pot " ὦ a es EL e a AREE A 
iz κ z = d 3 E - j m LI -- P i . 
E E -* ή 3 * i PT a 
=] "P 3 E ο... .“ πο κα. S * UE T 
"T "n" - " 2 P A -- ΠΠ B , * 
----' E PS s á e . r Ἢ F GAF 
ad d d κ y πε i zu "-- αν κεν κ LI - 
s 4 - 4 E .. E - LE " nd ar ae ee et od 
η * "attimo ' E E e ς . “ E E 
PI == B Ld La + - LI . ο * PLI LI .. LE 
e τν - m E E P" Li „> - - a . ΡΟ ΠΩ 
Ns PN "m ah - E " E cU ET ML 
- E - C DNI « - I LI ο. E Mes --- "TL 2 H "S 
we ΠΡΟ E η E n H "ILL P 
PL B 2 η Py κ.κ > NC ana “ " .- E i $ x 
oi a " "s P E " .- ed E > "m ee ae 
.ς a E HJ "E E E . πα, * 3 κκ 
" ) "E 2 "ETE ος E ` EI "E "a - "m 
τς E i z i i e πως -- ré B x κ . "t . 
" E " P 2 " s s PES ». * E EET 
PECE POE >. e "n P 5 κ.κ. E - €*5* 4 FS . » 3 «x E ο ο 
wn, d. bd "E n . ντ "» 5 a LE E E A ERES 
OREP ETETE α: φ ae P "T ο E E e~s, E Ba eA Kir m 
ΠΤ PD a Tur] ΓΝ πα ΠΣ τ. . " " - LL s LEE Sa .. A E 
I p - D "” - eo - το αἱ a E τ p "E -" ο ΕΙ ΠΠ 
Ρο νον aoc ΠΠ E PE ην "IP FL o = 4 κ ες e = ahd Msi - . . nm E XU Fy a 
EN ΝΡ ΝΟ E πο E T eMn "Eun MAIL) NDA i LE zi LED - πα. ^ rT E Ra SEA V πο 
" P ear E ULM MEE "E " ON IS M NM. και eC Sat = d * Id Εν. a iog E m 
PELLE us ΓΝ - " r ee *, ο...» η d id a ο d z E -- IM PE " ο 
SCELUS ΜΜΕ ον m "T "oua uU uU ML Me - ο ae E tæ E A A 
PL LA ESL eae "e - 5 " L E . n EA NM m E ul 
ΗΓ qe MALE X ΠΠ πο E "E ? " " . E P ος e E pecu net 
"nr M « X E x E « n $ S RET Bae πα ον rr: Den 
nu "XE m I * E . E PART ee eat ELI P E mn » ου "EE E PRECES 
"n " "ID EI - Ἢ TE) ΠΣ 2 "E p m E E -«---α«. = at is FS e PER E 
d id D E * E . " P d "x P L . ** ls E MENU E . Pa ee ww FIXE p . 5 =æ ο ο. - ε-. 4 -> μα m A 
paw any C ore . d - ΜΉΝ η “. 4 P "PE n ΠΠ ο g +. = - 5 πε " "PC am mt = > w " P E me η : esee PE 
4 aV "TTE EM oe - .. r ο ο ee ld E E * D we-t*? ΠΩ - "4 a cu ΓΝ eve TT A -- EEFT T CE ον E ΕΟ pU 
να να es bow. Tu E s LR esl κό η 3 gio: id ο ποπ αμ CET UN ον mI I LA PEL -—- "mm m ΠΟ ο -- ΠΟΣΟ 
" .. mS Ἢ E " ” E E fener " P v. "e. . LI ο... mM" μα LIL νο X Ur ME πο. -. . a « P eae te ser 
wee." auo? . os Dd -> v ο τ - * s 4 νά M d T ká kda - -— ο ed t "O ες ᾱ--ῳ 9 
μη S I PO Loin 1. * ° ο” a -- - o al Li ELS "δυο πο” E PL od TEE 
κο Lee cua baal μα 2 LL eg 3 xe d ES i ων. ba z "YT SEI "1 PI Lg LI -»* "E T E aa 
E ae ΤΝ πα ET 4 .” . s- * η LM P ^ "D - n j T oaa μα p Mops 
-——— ——— αμ ο... » η - a " "ET LI - Uu .. - - i E m m Tm ο πο μα, Ὁ E "LL 
— EC DEL ee ο πα... ον ον E Ne DU uU M E MEL. i ος 
c ΕΣ ες nl πλ... άν ο πες A - of fee "^ ο η z 
——————— "TOR AL ΕΕ diae " M EID E "E E -> "ES : τ - r 
—— - μμ ος D s * ΝΡ mr = ME QR ο τς "NC A E T 
— eu Ὁ ο] = ae »”- - ο, S a) P *,r * - tn e ΜΠ - PET as P 
μεσο πο ΡΕ TOE D E EXEC E c LL ees PEE I CU ecd LE "E nm ' " a » a 
— "E E ΓῚ " " E E «. n -- + m ΓΝ UM E er ο” 
c— — ΄ a, "- .*- t9 9 - ov Gad M ο... i id - s d ΤΙΝ "cr "qr Wr 
—— : ° e ic πο αν δα ν d Ὁ ο v - = 
- ο ο Š ο Ἢ p 5 at x 
εως" ο μα ος a Pria Res 
- *.* eE 
τ : πη ΕΣ ο ος ον 
~ ore » -«. - . Pr) 9” us we E ad - . ~. PPP a 
«T OE Mae OCT "s E ο Εξ. Aes e ri IL ree 
M M EE το "Nr d - A ap Oe ^ " a PE "OUTRE EURO -.. ο; ΡΣ ΝΟ yu 
C "MEET - LL m Π PIT UL d . "I nm ie D D: se ee wt tee ο ee “μα 
hot ee μερος ο όν zd [addi πια ος LE. Uno, ped ane eee mt tr ae Pe i ee D E per LN MAC «Δα 
cO κ Αρ ΙΡ... o E = .. SAs * 7 = 2 - -- παω ας, Er eer SET E rab 
- χη ΕΟ .. 5 T p - .-: m "T κας MTS πο κ τς pA 
- "I PENES ILI PUDE TEL M i NL. D n "M J -EEE Sa a em - τον ον ρα Midi tes ΝΥ. ον ο. 
μμ od py MEER 1 μον "uL dli: shira E = . ..Φ-- 24.5». << μη ο LL -ν aaa 
μα -«.”-- Li n τς C ο E . "EL "EL NEL a PERET O * - *e* "ρω... I py qu SEDE dad 
X ης. ασε μις. 1ο C M ντος ΗΕ 
μμ ΗΤΟ XE LAN or Al P A died "I UU » * --» νυν. ed Τη T E P ean s sees 
O AE SOTA i τ aere M EUM 
ρα. κ... ate goose 98 "Em Po ο Id "ET I 
Z ἐν. E πα. . - ο. μα .-νΦ» "4 a ere τος z 
ς 24--- ν - ΤΣΗ ο. -- apo a =h αλα . ar^’ PILAE PR id μα E bel 
- Seine gi τω i CAD SPEED diced πας RE" ote 3 "A fe - mnm PPS πα ο δν δι ου» 
"TU "x πο το νο κ τον - .^ "rM Peer ουσ Ἢ Τη ΠΩ Par ο ο αἱ αρα NS 
»- τρία. S curo m φόνο - ρος μήτε 5 ΓΩ DL er πρ Μα 2” 
= Μο λα τν Ὁ vw - sw. "- * me em . a» ΓΡ ΡΥ "rl 
Lu Mrd ” E .- 2 Μο κο 8 heut Prep ye od e re mid 
a wot fag Ff * . κί -+ PELIS LA ο) Τα reophp op P E η φομ 
| P M LIEF DLL E PIER FE Ly τω " μα 
λα ww" t * Pepin a ell olds hada B "M A ERU CENE. 
Any wae, H amm " ΕΟ dome. η Mime mE TE) piper TL) Us πια eines reme 
2 rol Cia = s ae darts πα να τὰ g md πο ο ο ο. DI US MIRI αερα as nr X TTL ν PE id 
Ώ «ν΄» PL vr amc ots uA ΝΗ ΠΤ BS oo ή T PS "eM Meroen Dm em = n amit ο ο P IET. Y pA 
-— MN MTS EL a - - ' ΓΙ ο ~ LÀ L] way? A" (9 de*a 9 CELLS TINI amt. eum "we V PI - ΙΤ ae 
gee rye μμ μμ η η LEE PE . ο κας hod . - LL LI Ματ LAM Lord ΡΠ E pe ee 
"P .,. E mE] Pane sod P ο... ΄ mieh D ae - νο ΠΟΤΟ. φον ο ο. μμ uS Lai 
ο αλ, m ¢ sneer NO E δες ον μα wt Fe wa oe to Ome wee r ο art Ω τα 
E sena d md enone ee be) See was, I» » albe ° pipe e a ihe ims - m. Pam Sot 9 : ΡΩΣ Τζών 
Το a mnnn? > mge C "e οἱ -υ ο” i3 τμ “= . ΟΡ ΝΤΟ μι αν αμ E οί 
Pe een, " V ΝΕΤ ΤΟ E NE des . ew " r Piai ΕΤ sere % P E μή ἽΝ La oisi ον τας saei 
Ων in mL d . v prn rin a ML T" . . μα ο ΕΡΕ ΝΟ ex A dapi iioc 
he ολ ο οπου ed olent η πρίειν OP: "ics n ^r TI PET ο καλώ 
rH Ww ώμο ολλ. em ew lw CU Pre. Ue! "—— E T CET "TL LU ^ Meier Η pere co apo tn 
cer TU ένο Y "I PX " ΤΟ CE «κ -————— koi D A pice 
"uu LE ud tune OA 8 PE E arn iia Cobh atadp lahat ~ E ... PIE ΟΝ ΠΡΟ ΕΝ I err ul ή ορ beet eh 
"arr ille" "PEL E odii .. * n^ acm 5 ΓΣ Lodel P ial "CL halal . ο ες ο ὁ Py 3 
ro 9^ FEX a a LI PL ix iab ed $» *. 9 Rhe I dil ants one ^ot m EL Toss ΙΙ. LLA E a as =" wm ap AR 
q^ ML S E ass harte E .. τη .-.. Lj νο. E did »* . a zty ae‘ ο shed = 
ery EI pa "OM Ms ο m « ter rn DENS ---- »ν . Pry "P * Κο τ ή 
Mid "nU καν νο δες. 1...” 9 E πο ο, . Ἡ ο P E ..- ... pe^" ST z η κο. πό μνήμες» 
ΝΕ να ah he "P PO dd ih dah ΠΩ LE ΄ "ECT 11 LL »a$* *d'a* E »" ον Lid Εν, bd "ELM Moin 
ο... Pd VOCE PERDE PL: - z Maur αφ, wes oe npr ye Tt PP pat ee LS 
re S ΤΩ ον ΝΟ dd M End € 9 - ny idi d ed PLU mee pom ae rd d 
"mE Y ΓΠΣ 1 & ἐν-.τώωνρα « £2. mcer P dbi r "ECL lodo "TIT "P" H ΡΠ; ΠΤ pt αμ Pg n Vega peris nm 
σος μμ... πη Ρον αμ TL. "PT etd EXCEL e . 4 4^ PPP 
qae pma ΠΤ elie irre n tee de ως Lat hi dia d ... -ἔϱ ἂνν PI 4 ahs ο E κ. ο” 7 Ην EJ "YET +’ Ò " TE 
PIDE did TL "EP EL es PILIS ος, LE LOL E bs dud e » Ls LIP a δις οσο ο πα "MI wawa val eode mas soe ae 
Pos POTTIE Dh hl Rael LLS "ONE ML 5» t ve poke © -s E EE TL Lido PENNE "aD ΠΣ, ΗΟ ΣΣ, 
petite cda As " ΜΡ ΤΙ Επ IL MN : ΤΙ ο a ΡΠ Κα; η. μι αν "PR 4-5 παλ... P pu s 
" Mae EL LN MOX DLE we M^ Φ ἐρι»» μπα πο er) "OT MEET E RS TNT T lee rg prr TE τας ΕΣ ΠΒ 
μμ πα δη ον "EE Lt co M er RT, ar tel elated ια ἂν εδ κ oleh ld po PLE eL m ο pv Ρ 
noL aahei €— tt Αν m El wry OF xr tate tliat So ῃ Poe €.» » eer E T a retten Hadr T ie 
a ΓΝ ΥΣ. Ll ΗΘ ΤΟ ᾽ν a Ee s μον Ww ^4 Q9 £9 :9** μμ ο ση σαν ον το m 
Paar PT Ls ater. nun Gs aa Por t? Prey Ser E, NES are ed SPT Wn ο asp ygihas m P petro = cera 
; πη i ry ee es ; «9 P E . -- woe hd [οἷο κ. οἱ μον ΗΕ ΘΙ E) Pls Ον 
CET MOM LEE ead on PAULI M Pal d PEEL am p M d "T TL "d E P μα deta od "n PEL M-— ot e 
P πως m d "PD ur err E Lus "EP bibas "gode E PE μη Ὁ". “ POIL a TET MCI μαι αλ 
irre eter w «ep * dae 9 Εν, Ἵν FLOS rt rov EUIS a E tap E κ. PL] Lied 
L "E mE din [e eed "xx E repeat ROME UE odit Fede te «. E 
φαν M" D Died Pe ΡΝ "PRI ΟΝ PELLI ide μυ T ΝΕ; r igi pnr 
POENI bd "Ον, η ἯΙ; Fond ated = a” oF ΠΟ LE CT α-- an awe ane (EIL) eei E ree ey Ce 1 
ad per err M sefandi t c LI Li mL να ».΄ "I p woe" LE m m νιν νυν ον 
. TROC D NET IL μα RT ΤΟ * πα rte CS aid πολ - ow weatap οκ. μμ ον 
μ.ο ος ILLE wr in Ν " E mr o id LED m E menm d ροκ. 
"NP dui diui η η ο... ΓΝ ΞΟ UL σα L] EDI adis SEP LE ii NIA NEL n ο E ων 
τ. ΠΗ 2 ua .ν t ο ο LR Ad d serv E Led LIII LE pere TIVI iiid "P mo pump 
ee Ραντ, ΤΕΣ & a4 W-* wh» a "I " "a qu Ld ΠΟ ΠΠ e E à am ng d aa ος ον ο 
πα λοι ο. οὐ τν ο. ΤΩ αυ Pere E EET ΩΙ η ο ο... x ια ΝΎ ΤΩΙ DIEL "T * x ore] ook 
LN eh he απ ο Ser ΠΠ πα J ΝΡ ΤΗ MUT ee eed κ.” ο P i od TJ σα πο uhi A ot atom r^ ELEC be 
P FRU X Μα ΤΝ ipd ipe otn LS Lied qs τ. « «-- ΡΏΡΤΕ HK mem Me vire grin mp E , 
see μανία eea ad head ΠΡ, ὑπ een ese ene Fade LE ei abend REI pA Lil si edm 
FEED PULL lbi PI LE ων LL dbi TLE S] CV ο ο... E TIU PEE I abu ed Do ανν mem 
ere ues ees « ‘ee νο. Ld m Ον dis Ln] a "masa 4$ — I7. A 2 pv Lh PNE w a Πο στ ΙΡ 
ων ο a b. è Ανν, πο ος Pore a did t td ο... AE ολ. ΜΠ, a a are a a a r e en Prea a Tane r 
mo ο Μος T Fio LOL E eed νι γα ied es μη ο ο ma ong ος Μι μα A 
Ἴσον, ΤΙΝ ΩΝ zl ned Pomp? qiu 4 LI ο. ων». ΓΡ ΕΝ E eda 
αυ ape Αν ανν ο ομιιφο καν 
νο να μόνά πλ... κ d. au Ve A uo sm coda agente 
H FIT. Pd Γον μα νο ο μα od 
μμ ον a w- mé. eo tM ο κ τς E 
t PONE bes Te ala amined eye wet 
peor a pex. s 
P E e ene 


ο cha 
Ἢ αν 
PVP ied 





ΠΩ 























Ca owe tr P 
πον N 
ην ai 1 πω tere 
ΡΥ ΤΙ PPP s per ee 
PT lid 
pL 
"a dioi * τὸν 
un Πλ Λο 
Pee πο Ed 
να ΟΙ αι 
των νο r αλ 
e P do μμ νοκ ον, 
κ Μο α΄ Ὃ ως ο ρτα μμ ss 
ον Lied D» Hg. Aeque νά 
μος ΡΝ k AR 
bed 
meo ie 
μα ο αν 
pL andis 





rye YS 





Sumo 
μα Ρα, 









































MUT ἂν rae 
mpi eru E 
" ο μμ 
ποσο ΠΜ Τὰ: Μπ ee "LI P obs 
PvP ble πα “-.. ΓΣ οἱ ΄.«οθβαΦ- κ PET LL a d iPr EET 2 SLT ested 
Pee ee CL Sadi Pee Ld doli it "eod ls ΤΉ ee τ η 
ων η ae ο “αἲξ rs BLA 
EAD VIT ΡΝ ΟΙ. ια, mr id P S d DETTA 
στ, UOTE ολ `- πο δα. AR 
λα νὰ p Poi "x "m 
ΣῊ "n να Το. Ρα él RTT 
ν΄“δ' “' ὅ » "^8 Tti d 18053 vo tmt 
P) TS IE τ κ ολλ. >t Pl Z PL οὐ 
όν ELI paper μη μμ n Eti paco drei ^pa m 
LLL moris vr id irai d λύρα πο nidum deanna 
πμ al inched ο πο ο ροκ 
pid 


















PLE 






"xd 





LINES IT 
ων αυ. 

πο λε. LI 
porem 








"EPI benedi n 
μα ων 
EIL Led 
PPS 
ΤΩ 
πο δή. 
nud ΠΤ η 























ay ΠΟ 
ο d a ΥΣ ο.) μμ πο ο ηλ η 
Eri OCT gern 
πμ ΙΝ ITI 
sig tee fl ee b 
METUS κο. 
RETI LA 
ολλ. Xs, "UP ο roS AT T αι ed LM is D 
ΙΝ Ls PU HEC ET LL or "m πολ) PET 
ΡΥ. λαδα ο πο Be 
J «4 OP ILI IIR ALS d -.ν. a uo) nn 
- τω ιν κ...” ταν ο. 
gau stert e ΡΤ ET d ην isi 
νο ον. 








ας OLET νι 
η T 
μα οκ Ὁ 
ο κα ο 





d 
ΤΩΙ 





































πο heel n 
pump κου 
-- aw deg mt m ΚΝ ΤΙ 
νυν ΤΗ 
ο 
ICT "E 
MJ tee, Oa eens ts tao petn rir A rn Reid 2. adt 
PLE κ ο. πμ.” να Perret τς. 4 patie teary vat PART EY et so seer 
Pere CIE LE LU LA [2 "NL vw tes ween eo * Ray eee κ. τι πο ο... γης "5 
ΠΤ LE Ισ... e πο μά ή ΠΙΟ; ¢ wre 
mL as .* Lia »» 
κο ΗΝ Peer a^ . 
ΓΡ Lila I DL πο λε. ape 
map T Ὁ ΩΝ il m 
no PTT να d va ^«^ f^ 75 V^ 
D rd n bed 
bod 


ΕΣΣΕΝ dia 
^tm 
PL αλ 








De τσ 





ΤΕ... w 





"EL [27] 
πλ." 




































ιά 
σα bd 
μη ΣΣ 
"mem eo] "E ο αλ. ELT LI we qu Ses 
μμ ΤΩ POET Ail 
"ol 
ΤΉ. LEM μή σσ αι 
μι ον poii qid ήν να 
ro) a Mh πο A wy take Troe 
avia 


d 








PES 
αν 
LEL Led 
Nro Lad 
Masa sta té as 


PLI Led d 
ΠΡΟΣ ΟΣ. 
Ἴ ΓΩ; κο 
ο Landed 


OEL ILA Raki 
































ιο 
ο ολων ο ed 
Ἢ 11. ο nd M 
ΜΡ ΩΙ b^ TT E 
"UE LULA diii bk ο.» 
μον ο αι την 
μασ ΕΝ μά 
en aedi m 
μον τς edi ο οί 
"mE sei 
μα ον 





"TLLA 
μπα λα λα nrw 
g ΚΥΡ ο ib ESSI ELE 

d ich apura 


ο τε. 
PIN ALL: MOM ΤΝ d 
Miroir ood 





Fue * 4 "m^ 
ο ο... 
ντ. 


ΠΝ λα λα 
ον 





ολ λαόν 
τον ο late 





ΗΝ td bb 


μη οπή 
Heel ΓΣ 


ΩΩ μμ 











































nesan, 
E T at da ted 
ODL νὰ 
η LLLA A 
ια. wee gad 8 RTL ΤΙ Oe ee a TATT EDE αμ 
ree ο AORT la νης τν δ | / Å 
Πω μα OC I e II AREFE MEER ο Ας eT 
"n 3 "^ ow μα wt TELLG a * vt sz arem PIA 
ΡΥ; ἘΠ ιά ως y mms MP iini 
t. ον MEL [ er LEE M 
LS Να STURE LLS LE ΤΙ bi 
μι ή. od Ἢ 
τὸν ο hake 
φως ο σὴν 

















ον Laid 


πλ 
μα ο ο. 


IT TP 





ert eode 





POET Ln a b cadit 


Pe total ob Le eda) 
ΠΤ idend 


PP a d 
ολ. 





NEM 
ο ο 
ΝΤ 
"TTE t 

































































Li 
i" LE Ld Loa 
rr ουν re eb d 
3 [ον ἀρ ην κο) rem OP ΙΡ ed 
LUI da Ld rd 
Ta: LIT ΠΣ ΟΦΗ 
PA » μα ο πλ ο ο L 
σον ῃ e aaa αμα] a EU NA 
η dap 0 tto ONT ELT aes μὸφ-« «» 
Dod uci pepe r x Fad et stats ‘Seay eee i pe M 
ΠΣΕ τ Ιω ΡΝ ΤΟΙ] ME isis ET Lb bi^ PN d 
πο οὐ Μπα ας eb PS Aces c rs Sada 
Db di ΠΕ τα. AL a P t 
"T - Hr P E t: ΡΣ, s se ld 
"IIS πω νι. Ην — tiro eran 5 PI Abr 
ΦΥ ουν Sd Ere MEL ΠΤ Α pS Tt a tat ade 
ο μμ τὰ... πα. ο ο Φε LI PN SD dtes on πο ο BLA rj omaes OT Ta nega asa 
4» "TTL did or CE MOE ALLE] DU lo ^ edil ahd n pp n An dnte 
PETS he aci did Pree δα, $ TTT dia ὑροὶ ataa E a Ad 
apap petar yaaya «Ky ta e Maa poe iind δν ο mantas dd viue 
14 e ΠΟ Ην νά pend αλ να 
Πο ® 7 












Mr iid 
mA 





+ 4 5... "VE 
ΕΤ oz dd LIS 4; NL ΠΤ does 
T o PL Ld ond ET os 
ae eee Mart 


ΗΝ λα 
υπ d PRA LE ο 

PITE LR 
mU NNI DL aid 











Li η 
αὐγή i-re νων ΤΩ 
ΜΥ ΤΟΣ Ρα δν 





ανω 
ων Ll 

















MILES Φφ d 
IP PLE Li 
Seas oO? πο. 
La TE d metn P 
Ra cole Oe TD ed d Paved ear. te P ΓΥΡΟΥ akoer 
il METTE I t νὰ ELE idu 
DEP ο λος 

POIL 





LM t 
Tin ICT IL MALA μωρο να go Me et 
m PVC PETIT bd ΠΤ Τη ΠΑΝ etre ET 

"ETT SALA [ος a Ariane τς ή LBS 
+ wee we. Che dui "IN 














ποτα ΠΤ ία m 


ΣΤΟ ΠΤ 
ΝΗ ΘΓ αν 


n ρε ο 
πο μμ ο ο αν 
wee 


ITE LOL nad 
ME edd ES IT 








[pid ae 
κ ο των 
ον eee TN ol οὐ Tia 


















ILL 

























PEF iad TUE bles od 
"rm ED LL Ph bel 
PEDE x 
r d 
0 Du a heer ie Le aval 
Πα Τα EU FREE ado ΤΌΝ εδ mE 
Per ars ΤΙ ed "T ὙΠ T LML Ad 7 
ο... ος αμ Mah mr T C del τα, μμ δή 
κο μα μπα TEM UD « ERIT 
Y TEE A di NITE UE LA CL ciii) egos ater 
¢ mI P EIS 











` 
wa waters CT ed lhe 
FREIE ΤΙ; 
ΤΝ ΣΤ ρε om eC EE EH 
Το ο νο Πο Νο. 
OT MESA! Ore rS T Lae ΑΝ 
ο TE αμ ο το» 
LM d seas ióv svo Y 
weiss d quc rato 


Meet CL esl 

w^ Y 

ΠΕ μά 
ΠΝ οκ. 

ο ή 

ο. πα 











Ημ Ata ts 
p TREE Ad 
N^ τν; 































LI Li 
Lj ΤΕ Λο. 
A TET ο ΠΤΙ [MEL | 
EI Pet LORE ES ME ee eee TEE ή”. 
πα πα OTTE RER a foit dn a 
TEE D DTI eye er ee A 
Rie Pe el Se idea i ΕΟΝ ἐν 
" πο μου.“ 
t poem V ΤΙΝ 1j 
πο”... v b π΄ DA 
i pL niat 
ris are E n aru 
protege 94549 v^ ΤΟ issuer do T oed 
Neap std Μο ου eec kel led 
μμ σος 





*a vis 





EL 
"i Ην * 


μμ ΠΥ 
φως ο οὐ pes abel = 
- um oe er 





a Ἡ 
PEL ae 





